TY - JOUR
T1 - Noise Reduction in CT Using Learned Wavelet-Frame Shrinkage Networks
AU - Zavala Mondragon, Luis A.
AU - Rongen, Peter M.J.
AU - Oliván Bescós, Javier
AU - de With, Peter H.N.
AU - van der Sommen, Fons
PY - 2022/8
Y1 - 2022/8
N2 - Encoding-decoding (ED) CNNs have demonstrated state-of-the-art performance for noise reduction over the past years. This has triggered the pursuit of better understanding the inner workings of such architectures, which has led to the theory of deep convolutional framelets (TDCF), revealing important links between signal processing and CNNs. Specifically, the TDCF demonstrates that ReLU CNNs induce low-rankness, since these models often do not satisfy the necessary redundancy to achieve perfect reconstruction (PR). In contrast, this paper explores CNNs that do meet the PR conditions. We demonstrate that in these type of CNNs soft shrinkage and PR can be assumed. Furthermore, based on our explorations we propose the learned wavelet-frame shrinkage network, or LWFSN and its residual counterpart, the rLWFSN. The ED path of the (r)LWFSN complies with the PR conditions, while the shrinkage stage is based on the linear expansion of thresholds proposed Blu and Luisier. In addition, the LWFSN has only a fraction of the training parameters (<1%) of conventional CNNs, very small inference times, low memory footprint, while still achieving performance close to state-of-the-art alternatives, such as the tight frame (TF) U-Net and FBPConvNet, in low-dose CT denoising.
AB - Encoding-decoding (ED) CNNs have demonstrated state-of-the-art performance for noise reduction over the past years. This has triggered the pursuit of better understanding the inner workings of such architectures, which has led to the theory of deep convolutional framelets (TDCF), revealing important links between signal processing and CNNs. Specifically, the TDCF demonstrates that ReLU CNNs induce low-rankness, since these models often do not satisfy the necessary redundancy to achieve perfect reconstruction (PR). In contrast, this paper explores CNNs that do meet the PR conditions. We demonstrate that in these type of CNNs soft shrinkage and PR can be assumed. Furthermore, based on our explorations we propose the learned wavelet-frame shrinkage network, or LWFSN and its residual counterpart, the rLWFSN. The ED path of the (r)LWFSN complies with the PR conditions, while the shrinkage stage is based on the linear expansion of thresholds proposed Blu and Luisier. In addition, the LWFSN has only a fraction of the training parameters (<1%) of conventional CNNs, very small inference times, low memory footprint, while still achieving performance close to state-of-the-art alternatives, such as the tight frame (TF) U-Net and FBPConvNet, in low-dose CT denoising.
KW - Convolutional neural networks
KW - wavelet frames
KW - noise reduction
KW - encoding-decoding
KW - Thresholding (Imaging)
KW - Convolution
KW - Computed tomography
KW - Noise reduction
KW - Encoding
KW - Convolutional Neural Networks
KW - Discrete wavelet transforms
KW - Neural Networks, Computer
KW - Signal-To-Noise Ratio
KW - Tomography, X-Ray Computed
KW - Image Processing, Computer-Assisted
UR - https://www.scopus.com/pages/publications/85125305377
U2 - 10.1109/TMI.2022.3154011
DO - 10.1109/TMI.2022.3154011
M3 - Article
C2 - 35201984
SN - 0278-0062
VL - 41
SP - 2048
EP - 2066
JO - IEEE Transactions on Medical Imaging
JF - IEEE Transactions on Medical Imaging
IS - 8
M1 - 9721076
ER -