采用深度学习与图像融合混合实现策略的低照度图像增强算法

doi:10.12263/DZXB.20191286

PDF(1717 KB)

电子学报 ›› 2021, Vol. 49 ›› Issue (1) : 72-76. DOI: 10.12263/DZXB.20191286

学术论文

采用深度学习与图像融合混合实现策略的低照度图像增强算法

徐少平, 林珍玉, 张贵珍, 陈孝国, 李芬

作者信息 +

A Low-Light Image Enhancement Algorithm Using the Hybrid Strategy of Deep Learning and Image Fusion

XU Shao-ping, LIN Zhen-yu, ZHANG Gui-zhen, CHEN Xiao-guo, LI Fen

Author information +

文章历史 +

摘要

提出了一种采用深度学习与图像融合混合实现策略的低照度图像增强算法.首先，利用照射分量预测模型直接基于输入的低照度图像快速地估计出其最佳照射分量并在Retinex模型框架下获得一张整体上适度曝光图像；其次，将低照度图像本身及它的过曝光图像作为适度曝光图像的修正补充图像参与融合；最后，采用局部结构化融合和色度加权融合机制技术将制备好的3张待融合图像进行融合以获得最终的增强图像.实验数据表明：本文算法相较于各种主流对比算法在主客观图像质量评价指标上均有显著优势，在局部图像结构细节上具有更好的边缘保持和颜色保真效果.

Abstract

An improved low-light image enhancement (LLIE) algorithm based on the hybrid strategy of deep learning and image fusion was proposed in this paper. We first adopted illumination prediction model to quickly estimate the optimal illumination component from a given low-light image and obtain its corresponding moderately exposed image within the framework of the Retinex model. Then the low-light image and its over-exposed image were used as supplementary images for the moderately exposed image. Finally, the three images were fused within the framework of the local structured fusion and the chrominance weighted fusion mechanism to obtain the final enhanced image. Experimental results demonstrate that, compared with the state-of-the-art LLIE algorithms, the proposed hybrid strategy has significant advantages in both subjective and objective image quality evaluation metrics with better image edge preservation and color fidelity effect on local image details.

导出引用

徐少平, 林珍玉, 张贵珍, 陈孝国, 李芬. 采用深度学习与图像融合混合实现策略的低照度图像增强算法[J]. 电子学报, 2021, 49(1): 72-76. https://doi.org/10.12263/DZXB.20191286

XU Shao-ping, LIN Zhen-yu, ZHANG Gui-zhen, CHEN Xiao-guo, LI Fen. A Low-Light Image Enhancement Algorithm Using the Hybrid Strategy of Deep Learning and Image Fusion[J]. Acta Electronica Sinica, 2021, 49(1): 72-76. https://doi.org/10.12263/DZXB.20191286

中图分类号： TP391.41

参考文献

[1] LORE K G,AKINTAYO A,SARKAR S.LLNet:A deep autoencoder approach to natural low-light image enhancement[J].Pattern Recognition,2017,61(1):650-662.
[2] PARK S,YU S,KIM M,et al.Dual autoencoder network for Retinex-based low-light image enhancement[J].IEEE Access,2018,6(5):22084-22093.
[3] GUO X J,LI Y,LING H B.LIME:Low-light image enhancement via illumination map estimation[J].IEEE Transactions on Image Processing,2017,26(2):982-993.
[4] CHEN C,CHEN Q F,XU J,et al.Learning to see in the dark[EB/OL].https://arxiv.org/abs/1805.01934,2019.
[5] ZHANG Y H,ZHANG J W,GUO X J.Kindling the darkness:A practical low-light image enhancer[EB/OL].https://arxiv.org/abs/1905.04161,2019.
[6] YING Z Q,LI G,GAO W.A bio-inspired multi-exposure fusion framework for low-light image enhancement[EB/OL].https://arxiv.org/abs/1711.00591,2019.
[7] ZHANG K,ZUO W M,CHEN Y J,et al.Beyond a Gaussian denoiser:Residual learning of deep CNN for image denoising[J].IEEE Transactions on Image Processing,2017,26(7):3142-3155.
[8] SEN P,KALANTARI N K,YAESOUBI M,et al.Robust patch-based HDR reconstruction of dynamic scenes[J].ACM Transactions on Graphics,2012,31(6):Article No.203.
[9] FU X Y,ZENG D L,HUANG Y,et al.A weighted variational model for simultaneous reflectance and illumination estimation[A].2016 IEEE Computer Vision & Pattern Recognition[C].Las Vegas,NV:IEEE,2016.2782-2790.
[10] FU X Y,ZENG D L,HUANG Y,et al.A fusion-based enhancing method for weakly illuminated images[J].Signal Processing,2016,129(5):82-96.
[11] WANG S H,ZHENG J,HU H M,et al.Naturalness preserved enhancement algorithm for non-uniform illumination images[J].IEEE Transactions on Image Processing,2013,22(9):3538-3548.
[12] LOH Y P,LIANG X F,CHAN C S.Low-light image enhancement using Gaussian process for features retrieval[J].Signal Processing,2019,74(2):175-190.
[13] CAI J R,GU S H,ZHANG L.Learning a deep single image contrast enhancer from multi-exposure images[J].IEEE Transactions on Image Processing,2018,27(4):2049-2062.
[14] LI M D,LIU J Y,YANG W H,et al.Structure-revealing low-light image enhancement via robust Retinex model[J].IEEE Transactions on Image Processing,2018,27(6):2828-2841.
[15] DAI Q,PU Y F,ZIAUR R,et al.Fractional-order fusion model for low-light image enhancement[J].Symmetry,2019,11(4):Article No.574.
[16] LOH Y P,LIANG X F,CHAN C S.Low-light image enhancement using Gaussian process for features retrieval[J].Signal Processing,2019,74(5):175-190.
[17] GU K,LIN W S,ZHAI G T,et al.No-reference quality metric of contrast-distorted images based on information maximization[J].IEEE Transactions on Cybernetics,2017,47(12):4559-4565.
[18] GU K,TAO D C,QIAO J F,et al.Learning a no-reference quality assessment model of enhanced images with big data[J].IEEE Transactions on Neural Networks and Learning Systems,2018,29(4):1301-1313.