采用深度学习与图像融合混合实现策略的低照度图像增强算法

doi:10.12263/DZXB.20191286

电子学报 ›› 2021, Vol. 49 ›› Issue (1): 72-76.DOI: 10.12263/DZXB.20191286

采用深度学习与图像融合混合实现策略的低照度图像增强算法

徐少平, 林珍玉, 张贵珍, 陈孝国, 李芬

南昌大学信息工程学院, 江西南昌 330031

收稿日期:2019-11-18 修回日期:2020-05-11 出版日期:2021-01-25 发布日期:2021-01-25
通讯作者: 徐少平
作者简介:林珍玉 女,1996年2月出生于江西省九江市.现为南昌大学硕士研究生,主要研究方向为图像处理与计算机视觉.E-mail:401030918076@email.ncu.edu.cn
基金资助:
国家自然科学基金（No.61662044，No.61163023，No.51765042）；江西省自然科学基金（No.20171BAB202017）

A Low-Light Image Enhancement Algorithm Using the Hybrid Strategy of Deep Learning and Image Fusion

XU Shao-ping, LIN Zhen-yu, ZHANG Gui-zhen, CHEN Xiao-guo, LI Fen

School of Information Engineering, Nanchang University, Nanchang, Jiangxi 330031, China

Received:2019-11-18 Revised:2020-05-11 Online:2021-01-25 Published:2021-01-25
Supported by:

摘要/Abstract

摘要： 提出了一种采用深度学习与图像融合混合实现策略的低照度图像增强算法.首先，利用照射分量预测模型直接基于输入的低照度图像快速地估计出其最佳照射分量并在Retinex模型框架下获得一张整体上适度曝光图像；其次，将低照度图像本身及它的过曝光图像作为适度曝光图像的修正补充图像参与融合；最后，采用局部结构化融合和色度加权融合机制技术将制备好的3张待融合图像进行融合以获得最终的增强图像.实验数据表明：本文算法相较于各种主流对比算法在主客观图像质量评价指标上均有显著优势，在局部图像结构细节上具有更好的边缘保持和颜色保真效果.

关键词: 低照度图像增强, 深度学习, 照射分量预测模型, 适度增强图像, 过曝光图像, 图像融合

Abstract: An improved low-light image enhancement (LLIE) algorithm based on the hybrid strategy of deep learning and image fusion was proposed in this paper.We first adopted illumination prediction model to quickly estimate the optimal illumination component from a given low-light image and obtain its corresponding moderately exposed image within the framework of the Retinex model.Then the low-light image and its over-exposed image were used as supplementary images for the moderately exposed image.Finally,the three images were fused within the framework of the local structured fusion and the chrominance weighted fusion mechanism to obtain the final enhanced image.Experimental results demonstrate that,compared with the state-of-the-art LLIE algorithms,the proposed hybrid strategy has significant advantages in both subjective and objective image quality evaluation metrics with better image edge preservation and color fidelity effect on local image details.

Key words: low-light image enhancement, deep learning, illumination predict model, moderately exposed image, over-exposed image, image fusion

中图分类号:

TP391.41

徐少平, 林珍玉, 张贵珍, 陈孝国, 李芬. 采用深度学习与图像融合混合实现策略的低照度图像增强算法[J]. 电子学报, 2021, 49(1): 72-76.

XU Shao-ping, LIN Zhen-yu, ZHANG Gui-zhen, CHEN Xiao-guo, LI Fen. A Low-Light Image Enhancement Algorithm Using the Hybrid Strategy of Deep Learning and Image Fusion[J]. Acta Electronica Sinica, 2021, 49(1): 72-76.

参考文献

[1] LORE K G,AKINTAYO A,SARKAR S.LLNet:A deep autoencoder approach to natural low-light image enhancement[J].Pattern Recognition,2017,61(1):650-662.
[2] PARK S,YU S,KIM M,et al.Dual autoencoder network for Retinex-based low-light image enhancement[J].IEEE Access,2018,6(5):22084-22093.
[3] GUO X J,LI Y,LING H B.LIME:Low-light image enhancement via illumination map estimation[J].IEEE Transactions on Image Processing,2017,26(2):982-993.
[4] CHEN C,CHEN Q F,XU J,et al.Learning to see in the dark[EB/OL].https://arxiv.org/abs/1805.01934,2019.
[5] ZHANG Y H,ZHANG J W,GUO X J.Kindling the darkness:A practical low-light image enhancer[EB/OL].https://arxiv.org/abs/1905.04161,2019.
[6] YING Z Q,LI G,GAO W.A bio-inspired multi-exposure fusion framework for low-light image enhancement[EB/OL].https://arxiv.org/abs/1711.00591,2019.
[7] ZHANG K,ZUO W M,CHEN Y J,et al.Beyond a Gaussian denoiser:Residual learning of deep CNN for image denoising[J].IEEE Transactions on Image Processing,2017,26(7):3142-3155.
[8] SEN P,KALANTARI N K,YAESOUBI M,et al.Robust patch-based HDR reconstruction of dynamic scenes[J].ACM Transactions on Graphics,2012,31(6):Article No.203.
[9] FU X Y,ZENG D L,HUANG Y,et al.A weighted variational model for simultaneous reflectance and illumination estimation[A].2016 IEEE Computer Vision & Pattern Recognition[C].Las Vegas,NV:IEEE,2016.2782-2790.
[10] FU X Y,ZENG D L,HUANG Y,et al.A fusion-based enhancing method for weakly illuminated images[J].Signal Processing,2016,129(5):82-96.
[11] WANG S H,ZHENG J,HU H M,et al.Naturalness preserved enhancement algorithm for non-uniform illumination images[J].IEEE Transactions on Image Processing,2013,22(9):3538-3548.
[12] LOH Y P,LIANG X F,CHAN C S.Low-light image enhancement using Gaussian process for features retrieval[J].Signal Processing,2019,74(2):175-190.
[13] CAI J R,GU S H,ZHANG L.Learning a deep single image contrast enhancer from multi-exposure images[J].IEEE Transactions on Image Processing,2018,27(4):2049-2062.
[14] LI M D,LIU J Y,YANG W H,et al.Structure-revealing low-light image enhancement via robust Retinex model[J].IEEE Transactions on Image Processing,2018,27(6):2828-2841.
[15] DAI Q,PU Y F,ZIAUR R,et al.Fractional-order fusion model for low-light image enhancement[J].Symmetry,2019,11(4):Article No.574.
[16] LOH Y P,LIANG X F,CHAN C S.Low-light image enhancement using Gaussian process for features retrieval[J].Signal Processing,2019,74(5):175-190.
[17] GU K,LIN W S,ZHAI G T,et al.No-reference quality metric of contrast-distorted images based on information maximization[J].IEEE Transactions on Cybernetics,2017,47(12):4559-4565.
[18] GU K,TAO D C,QIAO J F,et al.Learning a no-reference quality assessment model of enhanced images with big data[J].IEEE Transactions on Neural Networks and Learning Systems,2018,29(4):1301-1313.

采用深度学习与图像融合混合实现策略的低照度图像增强算法

A Low-Light Image Enhancement Algorithm Using the Hybrid Strategy of Deep Learning and Image Fusion

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	张波, 陆云杰, 秦东明, 邹国建. 一种卷积自编码深度学习的空气污染多站点联合预测模型[J]. 电子学报, 2022, 50(6): 1410-1427.
[2]	杨伟超, 杜宇, 文伟, 侯舒维, 徐常志, 张建华. 基于多重分形谱智能分析的卫星信号调制识别研究[J]. 电子学报, 2022, 50(6): 1336-1343.
[3]	彭闯, 王伦文, 胡炜林. 融合深度特征的电磁频谱异常检测算法[J]. 电子学报, 2022, 50(6): 1359-1369.
[4]	李政伟, 李佳树, 尤著宏, 聂茹, 赵欢, 钟堂波. 基于异质图注意力网络的miRNA与疾病关联预测算法[J]. 电子学报, 2022, 50(6): 1428-1435.
[5]	冀振燕, 韩梦豪, 宋晓军, 冯其波. 面向激光光条图像修复的循环相似度映射网络[J]. 电子学报, 2022, 50(5): 1234-1242.
[6]	廖勇, 李玉杰. 一种轻量化低复杂度的FDD大规模MIMO系统CSI反馈方法[J]. 电子学报, 2022, 50(5): 1211-1217.
[7]	潘敏婷, 王韫博, 朱祥明, 高思宇, 龙明盛, 杨小康. 基于无标签视频数据的深度预测学习方法综述[J]. 电子学报, 2022, 50(4): 869-886.
[8]	杨曦, 张鑫, 郭浩远, 王楠楠, 高新波. 基于不变特征的多源遥感图像舰船目标检测算法[J]. 电子学报, 2022, 50(4): 887-899.
[9]	崔亚奇, 何友, 唐田田, 熊伟. 一种深度学习航迹关联方法[J]. 电子学报, 2022, 50(3): 759-763.
[10]	张浩, 胡昌华, 杜党波, 裴洪, 张建勋. 多状态影响下基于Bi‑LSTM网络的锂电池剩余寿命预测方法[J]. 电子学报, 2022, 50(3): 619-624.
[11]	骈纬国, 吴映波, 陈蒙, 蔡俊鹏. 一种基于时空动态图注意力网络的共享出行需求预测方法[J]. 电子学报, 2022, 50(2): 432-439.
[12]	李居朋, 王颖慧, 李刚. 医学图像关键点检测深度学习方法研究与挑战[J]. 电子学报, 2022, 50(1): 226-237.
[13]	张聿远, 张立民, 闫文君. 基于深度多级残差网络的低信噪比下空频分组码识别方法[J]. 电子学报, 2022, 50(1): 79-88.
[14]	席亮, 刘涵, 樊好义, 张凤斌. 基于深度对抗学习潜在表示分布的异常检测模型[J]. 电子学报, 2021, 49(7): 1257-1265.
[15]	谢佳龙, 张波涛, 吕强. 一种基于双流融合3D卷积神经网络的动态头势识别方法[J]. 电子学报, 2021, 49(7): 1363-1369.