基于景深先验引导与环境光优化的图像去雾

麻文刚; 张亚东; 郭进

doi:10.12263/DZXB.20201127

您当前的位置：

首页 >

文章列表页 >

基于景深先验引导与环境光优化的图像去雾

学术论文 | 更新时间：2025-12-08

- 基于景深先验引导与环境光优化的图像去雾
- Image Dehazing Based on Priori Guidance of Depth of Field and Optimization of Ambient Light
- 电子学报 2022年50卷第7期页码：1708-1721
- 作者机构：
  
  西南交通大学信息科学与技术学院，四川成都 611756
- 作者简介：
  
  [ "麻文刚男，1993年出生，甘肃天水人.西南交通大学博士生.主要研究方向为智能交通图像处理、通信系统等.E-mail: 1248564936@qq.com" ]
  [ "张亚东男，1983年出生，河南商丘人.博士，西南交通大学讲师，硕士生导师.主要研究方向为计算机技术、系统可靠性与安全性理论及系统仿真测试等.E-mail: ydzhang@home.swjtu.edu.cn" ]
  [ "郭进男，1960年出生，四川成都人.博士，西南交通大学教授，博士生导师.主要研究方向为系统安全理论、安全苛求系统设计与验证等.E-mail: jguo_scce@swjtu.edu.cn" ]
- 基金信息：
  
  国家自然科学基金青年基金(61703349);中央高校基本科研业务费专项资金(2682017CX101);中国铁路总公司科技研究开发计划课题(N2018G062;K2018G011)
- DOI：10.12263/DZXB.20201127
  中图分类号： TP391.4;
- 收稿：2020-10-13，
  
  修回：2021-05-31，
  
  纸质出版：2022-07-25
- 稿件说明：
移动端阅览
麻文刚,张亚东,郭进.基于景深先验引导与环境光优化的图像去雾[J].电子学报,2022,50(07):1708-1721.

MA Wen-gang,ZHANG Ya-dong,GUO Jin.Image Dehazing Based on Priori Guidance of Depth of Field and Optimization of Ambient Light[J].ACTA ELECTRONICA SINICA,2022,50(07):1708-1721.
麻文刚,张亚东,郭进.基于景深先验引导与环境光优化的图像去雾[J].电子学报,2022,50(07):1708-1721. DOI： 10.12263/DZXB.20201127.

MA Wen-gang,ZHANG Ya-dong,GUO Jin.Image Dehazing Based on Priori Guidance of Depth of Field and Optimization of Ambient Light[J].ACTA ELECTRONICA SINICA,2022,50(07):1708-1721. DOI： 10.12263/DZXB.20201127.

摘要

针对暗通道先验存在的边缘去雾不彻底及细节信息丢失等问题，提出了一种景深引导网络（Depth Guided Network，DGN）与环境光优化的图像去雾方法.首先，通过DGN中的图像去模糊分支与景深先验信息将有雾图像复原为初始清晰图像，同时提取图像中的景深信息，根据DGN中的景深细调网络恢复出景深图的边界与结构；然后，为了使细调后景深信息转化为图像特征，利用空间特征变换（Spatial Feature Transform，SFT）层将图像进行迭代变换，同时结合缩放及平移与初始清晰图像进行特征融合，根据景深引导将初始清晰图像进行优化；最后，为了进一步使复原图像具有适宜色彩与较高对比度，将动态环境光细化后用于图像去雾，进一步优化图像细节信息.实验表明：从主观对比来看，得到的复原图像平滑性较好，动态环境光可以增强图像的细节信息，得到对比度较高的图像；从客观对比分析来看，本文方法对合成有雾图像处理后的结构相似性与峰值信噪比的均值分别为88.78%和22.98 dB，对真实有雾图像处理后的细节强度与色彩还原度的均值分别为0.436 8和0.794.综合对比其他去雾方法，本文方法在性能指标最优的同时运行时间最短，能够适用于复杂环境场景的实时性去雾，且具有较好的鲁棒性.

Abstract

Under the dark channel prior

there are incomplete edge defogs and loss of detailed information. Therefore

an image depthing method based on a depth guided network(DGN) and optimization of ambient light is proposed. First

the foggy image was restored to the initial clear image by using the image deblurring branch and depth of field prior information in the DGN. Meanwhile

the depth of field information in the image was extracted. The depth-of-field fine-tuning network in DGN was used to restore the boundaries and structures in the depth-of-field map. Then

the spatial feature transform(SFT) layer was used to transform the image iteratively. The purpose of transforming the fine-tuned depth information into image features was achieved. Moreover

zooming

panning

and initial clear image features were merged. Depth of field guidance was used to optimize the original image. Finally

the dynamic ambient light was refined and used for image defogging. The detailed information of the image was further optimized. The purpose of the restored image with suitable color and higher contrast was achieved. Experiments show that the smoothness of the restored image obtained from the subjective comparison is better. The dynamic ambient light optimization can enhance the detailed information of the image. Images with better contrast can be obtained. The mean value of SSIM and PSNR obtained by synthesizing foggy images is 88.78% and 22.98 dB

respectively. The average value of the detail intensity and the color reproduction obtained from the real foggy image are 0.436 8 and 0.794

respectively. When compared with other defogging methods

it has the best performance index and the shortest time. Furthermore

its advantage lies in better real-time defogging. Moreover

it has good robustness.

关键词

Keywords

references

嵇晓强 , 戴明 , 尹传历 , 等 . 航拍降质图像的去雾处理 [J]. 光学精密工程 , 2011 , 19 ( 7 ): 1659 - 1668 .

JI X Q , DAI M , YIN C L , et al . Haze removal for aerial degraded images [J]. Optics and Precision Engineering , 2011 , 19 ( 7 ): 1659 - 1668 . (in Chinese)

李佳童 , 章毓晋 . 图像去雾算法的改进和主客观性能评价 [J]. 光学精密工程 , 2017 , 25 ( 3 ): 735 - 741 .

LI J T , ZHANG Y J . Improvements of image haze removal algorithm and its subjective and objective performance evaluation [J]. Optics and Precision Engineering , 2017 , 25 ( 3 ): 735 - 741 . (in Chinese)

TAN R T . Visibility in bad weather from a single image [C]// 2008 IEEE Conference on Computer Vision and Pattern Recognition . Anchorage : IEEE , 2008 : 1 - 8 .

FATTAL R . Single image dehazing [J]. ACM Transactions on Graphics , 2008 , 27 ( 3 ): 1 - 9 .

HE L Y , ZHAO J Z , ZHENG N N , et al . Haze removal using the difference-structure-preservation prior [J]. IEEE Transactions on Image Processing , 2017 , 26 ( 3 ): 1063 - 1075 .

GIBSON K B , VÕ D T , NGUYEN T Q . An investigation of dehazing effects on image and video coding [J]. IEEE Transactions on Image Processing: A Publication of the IEEE Signal Processing Society , 2012 , 21 ( 2 ): 662 - 673 .

刘冬梅 , 常发亮 . 基于非下采样轮廓小波变换增强的从粗到精的显著性检测 [J]. 光学学报 , 2019 , 39 ( 1 ): 0115003 .

LIU D M , CHANG F L . Coarse-to-fine saliency detection based on non-subsampled contourlet transform enhancement [J]. Acta Optica Sinica , 2019 , 39 ( 1 ): 0115003 . (in Chinese)

陈永 , 郭红光 , 艾亚鹏 . 基于双域分解的多尺度深度学习单幅图像去雾 [J]. 光学学报 , 2020 , 40 ( 2 ): 0210003 .

CHEN Y , GUO H G , AI Y P . Single image dehazing of multiscale deep-learning based on dual-domain decomposition [J]. Acta Optica Sinica , 2020 , 40 ( 2 ): 0210003 . (in Chinese)

刘海波 , 杨杰 , 吴正平 , 等 . 基于暗通道先验和Retinex理论的快速单幅图像去雾方法 [J]. 自动化学报 , 2015 , 41 ( 7 ): 1264 - 1273 .

LIU H B , YANG J , WU Z P , et al . A fast single image dehazing method based on dark channel prior and retinex theory [J]. Acta Automatica Sinica , 2015 , 41 ( 7 ): 1264 - 1273 . (in Chinese)

陈书贞 , 任占广 , 练秋生 . 基于改进暗通道和导向滤波的单幅图像去雾算法 [J]. 自动化学报 , 2016 , 42 ( 3 ): 455 - 465 .

CHEN S Z , REN Z G , LIAN Q S . Single image dehazing algorithm based on improved dark channel prior and guided filter [J]. Acta Automatica Sinica , 2016 , 42 ( 3 ): 455 - 465 . (in Chinese)

张小刚 , 唐美玲 , 陈华 , 等 . 一种结合双区域滤波和图像融合的单幅图像去雾算法 [J]. 自动化学报 , 2014 , 40 ( 8 ): 1733 - 1739 .

ZHANG X G , TANG M L , CHEN H , et al . A dehazing method in single image based on double-area filter and image fusion [J]. Acta Automatica Sinica , 2014 , 40 ( 8 ): 1733 - 1739 . (in Chinese)

TAREL J P , HAUTIÈRE N . Fast visibility restoration from a single color or gray level image [C]// 2009 IEEE 12th International Conference on Computer Vision . Kyoto : IEEE , 2009 : 2201 - 2208 .

何林远 , 毕笃彦 , 熊磊 , 等 . 基于亮度反馈的彩色雾霾图像增强算法 [J]. 电子学报 , 2015 , 43 ( 10 ): 1978 - 1983 .

HE L Y , BI D Y , XIONG L , et al . Color image haze removal algorithm based on luminance feedback [J]. Acta Electronica Sinica , 2015 , 43 ( 10 ): 1978 - 1983 . (in Chinese)

孙伟 , 李大健 , 刘宏娟 , 等 . 基于大气散射模型的单幅图像快速去雾 [J]. 光学精密工程 , 2013 , 21 ( 4 ): 1040 - 1046 .

SUN W , LI D J , LIU H J , et al . Fast single image fog removal based on atmospheric scattering model [J]. Optics and Precision Engineering , 2013 , 21 ( 4 ): 1040 - 1046 . (in Chinese)

TANG K T , YANG J C , WANG J . Investigating haze-relevant features in a learning framework for image dehazing [C]// 2014 IEEE Conference on Computer Vision and Pattern Recognition . Columbus : IEEE , 2014 : 2995 - 3002 .

CAI B L , XU X M , JIA K , et al . DehazeNet: An end-to-end system for single image haze removal [J]. IEEE Transactions on Image Processing: A Publication of the IEEE Signal Processing Society , 2016 , 25 ( 11 ): 5187 - 5198 .

王柯俨 , 王迪 , 赵熹 , 等 . 基于卷积神经网络的联合估计图像去雾算法 [J]. 吉林大学学报(工学版) , 2020 , 50 ( 5 ): 1771 - 1777 .

WANG K Y , WANG D , ZHAO X , et al . Image dehazing based on joint estimation via convolutional neural network [J]. Journal of Jilin University(Engineering and Technology Edition) , 2020 , 50 ( 5 ): 1771 - 1777 . (in Chinese)

肖进胜 , 周景龙 , 雷俊锋 , 等 . 基于霾层学习的单幅图像去雾算法 [J]. 电子学报 , 2019 , 47 ( 10 ): 2142 - 2148 .

XIAO J S , ZHOU J L , LEI J F , et al . Single image dehazing algorithm based on the learning of hazy layers [J]. Acta Electronica Sinica , 2019 , 47 ( 10 ): 2142 - 2148 . (in Chinese)

陈清江 , 张雪 . 基于并联卷积神经网络的图像去雾 [J]. 自动化学报 , 2021 , 47 ( 7 ): 1739 - 1748 .

CHEN Q J , ZHANG X . Single image dehazing based on multiple convolutional neural networks [J]. Acta Automatica Sinica , 2021 , 47 ( 7 ): 1739 - 1748 . (in Chinese)

HUANG S C , CHEN B H , CHENG Y J . An efficient visibility enhancement algorithm for road scenes captured by intelligent transportation systems [J]. IEEE Transactions on Intelligent Transportation Systems , 2014 , 15 ( 5 ): 2321 - 2332 .

KIM J H , JANG W D , SIM J Y , et al . Optimized contrast enhancement for real-time image and video dehazing [J]. Journal of Visual Communication and Image Representation , 2013 , 24 ( 3 ): 410 - 425 .

ZHU Q S , MAI J M , SHAO L . A fast single image haze removal algorithm using color attenuation prior [J]. IEEE Transactions on Image Processing: A Publication of the IEEE Signal Processing Society , 2015 , 24 ( 11 ): 3522 - 3533 .

SIMONYAN K , ZISSERMAN A . Very deep convolutional networks for large-scale image recognition [EB/OL]. ( 2015 )[2020]. https://arxiv.org/abs/1409.1556 https://arxiv.org/abs/1409.1556 .

李大鹏 , 禹晶 , 肖创柏 . 图像去雾的无参考客观质量评测方法 [J]. 中国图象图形学报 , 2011 , 16 ( 9 ): 1753 - 1757 .

LI D P , YU J , XIAO C B . No-reference quality assessment method for defogged images [J]. Journal of Image and Graphics , 2011 , 16 ( 9 ): 1753 - 1757 . (in Chinese)

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于跨层注意力特征交互和多尺度通道注意力的单幅图像去雾网络

基于梯度引导偏振度估算的图像去雾

基于双判别器异构CycleGAN框架下多阶通道注意力校准的室外图像去雾

双注意力引导的细节和结构信息融合图像去雾网络