采用深度学习与图像融合混合实现策略的低照度图像增强算法

doi:10.12263/DZXB.20191286

电子学报 ›› 2021, Vol. 49 ›› Issue (1): 72-76.DOI: 10.12263/DZXB.20191286

采用深度学习与图像融合混合实现策略的低照度图像增强算法

徐少平, 林珍玉, 张贵珍, 陈孝国, 李芬

南昌大学信息工程学院, 江西南昌 330031

收稿日期:2019-11-18 修回日期:2020-05-11 出版日期:2021-01-25
- 通讯作者:
- 徐少平
- 作者简介:
- 林珍玉 女,1996年2月出生于江西省九江市.现为南昌大学硕士研究生,主要研究方向为图像处理与计算机视觉.E-mail:401030918076@email.ncu.edu.cn
- 基金资助:
- 国家自然科学基金 (No.61662044，No.61163023，No.51765042）; 江西省自然科学基金 (No.20171BAB202017）

A Low-Light Image Enhancement Algorithm Using the Hybrid Strategy of Deep Learning and Image Fusion

XU Shao-ping, LIN Zhen-yu, ZHANG Gui-zhen, CHEN Xiao-guo, LI Fen

School of Information Engineering, Nanchang University, Nanchang, Jiangxi 330031, China

Received:2019-11-18 Revised:2020-05-11 Online:2021-01-25 Published:2021-01-25
- Corresponding author:
- XU Shao-ping
- Supported by:
- National Natural Science Foundation of China (No.61662044, No.61163023, No.51765042); Natural Science Foundation of Jiangxi Province, China (No.20171BAB202017)

摘要/Abstract

摘要： 提出了一种采用深度学习与图像融合混合实现策略的低照度图像增强算法.首先，利用照射分量预测模型直接基于输入的低照度图像快速地估计出其最佳照射分量并在Retinex模型框架下获得一张整体上适度曝光图像；其次，将低照度图像本身及它的过曝光图像作为适度曝光图像的修正补充图像参与融合；最后，采用局部结构化融合和色度加权融合机制技术将制备好的3张待融合图像进行融合以获得最终的增强图像.实验数据表明：本文算法相较于各种主流对比算法在主客观图像质量评价指标上均有显著优势，在局部图像结构细节上具有更好的边缘保持和颜色保真效果.

关键词: 低照度图像增强, 深度学习, 照射分量预测模型, 适度增强图像, 过曝光图像, 图像融合

Abstract: An improved low-light image enhancement (LLIE) algorithm based on the hybrid strategy of deep learning and image fusion was proposed in this paper. We first adopted illumination prediction model to quickly estimate the optimal illumination component from a given low-light image and obtain its corresponding moderately exposed image within the framework of the Retinex model. Then the low-light image and its over-exposed image were used as supplementary images for the moderately exposed image. Finally, the three images were fused within the framework of the local structured fusion and the chrominance weighted fusion mechanism to obtain the final enhanced image. Experimental results demonstrate that, compared with the state-of-the-art LLIE algorithms, the proposed hybrid strategy has significant advantages in both subjective and objective image quality evaluation metrics with better image edge preservation and color fidelity effect on local image details.

Key words: low-light image enhancement, deep learning, illumination predict model, moderately exposed image, over-exposed image, image fusion

中图分类号:

TP391.41

徐少平, 林珍玉, 张贵珍, 等. 采用深度学习与图像融合混合实现策略的低照度图像增强算法[J]. 电子学报, 2021, 49(1): 72-76.

XU Shao-ping, LIN Zhen-yu, ZHANG Gui-zhen, et al. A Low-Light Image Enhancement Algorithm Using the Hybrid Strategy of Deep Learning and Image Fusion[J]. Acta Electronica Sinica, 2021, 49(1): 72-76.

参考文献

[1] LORE K G,AKINTAYO A,SARKAR S.LLNet:A deep autoencoder approach to natural low-light image enhancement[J].Pattern Recognition,2017,61(1):650-662.
[2] PARK S,YU S,KIM M,et al.Dual autoencoder network for Retinex-based low-light image enhancement[J].IEEE Access,2018,6(5):22084-22093.
[3] GUO X J,LI Y,LING H B.LIME:Low-light image enhancement via illumination map estimation[J].IEEE Transactions on Image Processing,2017,26(2):982-993.
[4] CHEN C,CHEN Q F,XU J,et al.Learning to see in the dark[EB/OL].https://arxiv.org/abs/1805.01934,2019.
[5] ZHANG Y H,ZHANG J W,GUO X J.Kindling the darkness:A practical low-light image enhancer[EB/OL].https://arxiv.org/abs/1905.04161,2019.
[6] YING Z Q,LI G,GAO W.A bio-inspired multi-exposure fusion framework for low-light image enhancement[EB/OL].https://arxiv.org/abs/1711.00591,2019.
[7] ZHANG K,ZUO W M,CHEN Y J,et al.Beyond a Gaussian denoiser:Residual learning of deep CNN for image denoising[J].IEEE Transactions on Image Processing,2017,26(7):3142-3155.
[8] SEN P,KALANTARI N K,YAESOUBI M,et al.Robust patch-based HDR reconstruction of dynamic scenes[J].ACM Transactions on Graphics,2012,31(6):Article No.203.
[9] FU X Y,ZENG D L,HUANG Y,et al.A weighted variational model for simultaneous reflectance and illumination estimation[A].2016 IEEE Computer Vision & Pattern Recognition[C].Las Vegas,NV:IEEE,2016.2782-2790.
[10] FU X Y,ZENG D L,HUANG Y,et al.A fusion-based enhancing method for weakly illuminated images[J].Signal Processing,2016,129(5):82-96.
[11] WANG S H,ZHENG J,HU H M,et al.Naturalness preserved enhancement algorithm for non-uniform illumination images[J].IEEE Transactions on Image Processing,2013,22(9):3538-3548.
[12] LOH Y P,LIANG X F,CHAN C S.Low-light image enhancement using Gaussian process for features retrieval[J].Signal Processing,2019,74(2):175-190.
[13] CAI J R,GU S H,ZHANG L.Learning a deep single image contrast enhancer from multi-exposure images[J].IEEE Transactions on Image Processing,2018,27(4):2049-2062.
[14] LI M D,LIU J Y,YANG W H,et al.Structure-revealing low-light image enhancement via robust Retinex model[J].IEEE Transactions on Image Processing,2018,27(6):2828-2841.
[15] DAI Q,PU Y F,ZIAUR R,et al.Fractional-order fusion model for low-light image enhancement[J].Symmetry,2019,11(4):Article No.574.
[16] LOH Y P,LIANG X F,CHAN C S.Low-light image enhancement using Gaussian process for features retrieval[J].Signal Processing,2019,74(5):175-190.
[17] GU K,LIN W S,ZHAI G T,et al.No-reference quality metric of contrast-distorted images based on information maximization[J].IEEE Transactions on Cybernetics,2017,47(12):4559-4565.
[18] GU K,TAO D C,QIAO J F,et al.Learning a no-reference quality assessment model of enhanced images with big data[J].IEEE Transactions on Neural Networks and Learning Systems,2018,29(4):1301-1313.

采用深度学习与图像融合混合实现策略的低照度图像增强算法

A Low-Light Image Enhancement Algorithm Using the Hybrid Strategy of Deep Learning and Image Fusion

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	李钦, 刘伟, 牛朝阳, 宝音图, 惠周勃. 低信噪比下基于分裂EfficientNet网络的雷达信号调制方式识别[J]. 电子学报, 2023, 51(3): 675-686.
[2]	范兵兵, 何庭建, 张聪炫, 陈震, 黎明. 联合遮挡约束与残差补偿的特征金字塔光流计算方法[J]. 电子学报, 2023, 51(3): 648-657.
[3]	张聿远, 闫文君, 张立民. 基于多模态特征融合网络的空时分组码识别算法[J]. 电子学报, 2023, 51(2): 489-498.
[4]	许新征, 李杉. 基于特征膨胀卷积模块的轻量化技术研究[J]. 电子学报, 2023, 51(2): 355-364.
[5]	张永梅, 孙捷. 基于动静态特征双输入神经网络的咳嗽声诊断COVID-19算法[J]. 电子学报, 2023, 51(1): 202-212.
[6]	袁海英, 成君鹏, 曾智勇, 武延瑞. Mobile_BLNet：基于Big-Little Net的轻量级卷积神经网络优化设计[J]. 电子学报, 2023, 51(1): 180-191.
[7]	王神龙, 雍宇, 吴晨睿. 基于伪孪生神经网络的低纹理工业零件6D位姿估计[J]. 电子学报, 2023, 51(1): 192-201.
[8]	李滔, 董秀成, 林宏伟. 基于深监督跨尺度注意力网络的深度图像超分辨率重建[J]. 电子学报, 2023, 51(1): 128-138.
[9]	郭晓轩, 冯其波, 冀振燕, 郑发家, 杨燕燕. 多线激光光条图像缺陷分割模型研究[J]. 电子学报, 2023, 51(1): 172-179.
[10]	贾童瑶, 卓力, 李嘉锋, 张菁. 基于深度学习的单幅图像去雾研究进展[J]. 电子学报, 2023, 51(1): 231-245.
[11]	何滢婕, 刘月峰, 边浩东, 郭威, 张小燕. 基于Informer的电池荷电状态估算及其稀疏优化方法[J]. 电子学报, 2023, 51(1): 50-56.
[12]	吴靖, 叶晓晶, 黄峰, 陈丽琼, 王志锋, 刘文犀. 基于深度学习的单帧图像超分辨率重建综述[J]. 电子学报, 2022, 50(9): 2265-2294.
[13]	李雪莹, 王田路, 梁鹏, 王翀. 基于系统模型的用户评论中非功能需求的自动分类[J]. 电子学报, 2022, 50(9): 2079-2089.
[14]	琚长瑞, 秦晓燕, 袁广林, 李豪, 朱虹. 尺度敏感损失与特征融合的快速小目标检测方法[J]. 电子学报, 2022, 50(9): 2119-2126.
[15]	张志昌, 于沛霖, 庞雅丽, 朱林, 曾扬扬. SMGN：用于对话状态跟踪的状态记忆图网络[J]. 电子学报, 2022, 50(8): 1851-1858.