In order to solve the problems of noise amplification
insufficient detail and color restoration in the process of low‑light image enhancement
this paper proposes a method of low‑light image enhancement based on attention residual dense‑generative adversarial networks (ARD‑GAN). Firstly
the method generates a global exposure attention map in the global illumination estimation module (GIEM) to guide the subsequent modules to enhance the illumination better; secondly
it adopts the convolution and residual module (CRM) and the channel attention residual dense module (CARDM) to extract shallow features and deep features respectively
and fuses different features of levels to obtain better detailed information; furthermore
based on the CARDM
the dense connection and batch normalization are combined to suppress noise. Finally
the improved loss function restores the enhanced image color better. Comprehensive experiments are conducted
which show that ARD‑GAN can significantly outperform mainstream algorithms in subjective vision and objective evaluation indicators.
关键词
Keywords
references
Reza A M . Realization of the contrast limited adaptive histogram equalization (CLAHE) for real‑time image enhancement [J]. Journal of VLSI Signal Processing Systems for Signal , Image and Video Technology, 2004 , 38 ( 1 ): 35 - 44 .
Guo X , Li Y , Ling H . LIME: Low‑light image enhancement via illumination map estimation [J]. IEEE Transactions on image processing , 2017 , 26 ( 2 ): 982 - 993 .
Dong X , Wang G , Pang Y , et al . Fast efficient algorithm for enhancement of low lighting video [A]. 2011 IEEE International Conference on Multimedia and Expo [C]. USA : IEEE , 2011 . 1 - 6 .
Tao L , Zhu C , Xiang G , et al . LLCNN : A convolutional neural network for low‑light image enhancement[A]. 2017 IEEE Visual Communications and Image Processing (VCIP) [C]. USA : IEEE , 2017 . 1 - 4 .
Zhang K , Zuo W , Chen Y , et al . Beyond a Gaussian denoiser: Residual learning of deep CNN for image denoising [J]. IEEE Transactions on Image Processing , 2017 , 26 ( 7 ): 3142 - 3155 .
Zhang H , Goodfellow I , Metaxas D , et al . Self‑attention generative adversarial networks [EB/OL]. https: //arxiv.org/abs/1805.08318 https://arxiv.org/abs/1805.08318 , 2018 .
Zhang Y , Tian Y , Kong Y , et al . Residual dense network for image super‑resolution [A]. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition [C]. USA : IEEE , 2018 . 2472 - 2481 .
Huang G , Liu Z , Van Der Maaten L , et al . Densely connected convolutional networks [A]. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [C]. USA : IEEE , 2017 . 4700 - 4708 .
He K , Zhang X , Ren S , et al . Deep residual learning for image recognition [A]. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [C]. USA : IEEE , 2016 . 770 - 778 .
Sandler M , Howard A , Zhu M , et al . Mobilenetv2 : Inverted residuals and linear bottlenecks[A]. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition [C]. USA : IEEE , 2018 . 4510 - 4520 .
Jiang Z T , Qin L L . Low‑light image enhancement method based on U‑net generative adversarial network [J]. Acta Electronica Sinica , 2020 , 48 ( 2 ): 258 - 264 . (in Chinese)
Lv F , Lu F , Wu J , et al . MBLLEN: Low‑light image/video enhancement using CNNs [A]. BMVC 2018 [C]. UK , 2018 . 220 .
Mao X , Li Q , Xie H , et al . Least squares generative adversarial networks [A]. Proceedings of the IEEE International Conference on Computer Vision (ICCV) [C]. USA : IEEE , 2017 . 2794 - 2802 .
Wang W , Wei C , Yang W , et al . GLADNet : Low‑light enhancement network with global awareness[A]. 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) [C]. USA : IEEE , 2018 . 751 - 755 .
Shen L , Yue Z , Feng F , et al . Msr‑net: Low‑light image enhancement using deep convolutional network [J]. arXiv preprint arXiv: 1711.02488 , 2017 .
Loh Y P , Chan C S . Getting to know low‑light images with the exclusively dark dataset [J]. Computer Vision and Image Understanding , 2019 , 178 : 30 - 42 .
Cai J , Gu S , Zhang L . Learning a deep single image contrast enhancer from multi‑exposure images [J]. IEEE Transactions on Image Processing , 2018 , 27 ( 4 ): 2049 - 2062 .
Chen Z , Jiang T , Tian Y . Quality assessment for comparing image enhancement algorithms [A]. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition [C]. USA : IEEE , 2014 . 3003 - 3010 .