Dual Attention-Guided Detail and Structure Information Fusion Network for Image Dehazing

GAO Ji-rui; LI Hua-feng; ZHANG Ya-fei; XIE Ming-hong; LI Fan

doi:10.12263/DZXB.20211549

您当前的位置：

首页 >

文章列表页 >

Dual Attention-Guided Detail and Structure Information Fusion Network for Image Dehazing

PAPERS | 更新时间：2025-07-02

- Dual Attention-Guided Detail and Structure Information Fusion Network for Image Dehazing
- ACTA ELECTRONICA SINICA Vol. 51, Issue 1, Pages: 160-171(2023)
- 作者机构：
  
  1.昆明理工大学信息工程与自动化学院，云南昆明 650500
  2.云南省人工智能重点实验室，云南昆明 650500
- 作者简介：
- 基金信息：
- DOI：10.12263/DZXB.20211549
  CLC： TP399;
- Received：19 November 2021，
  
  Revised：2022-04-25，
  
  Published：25 January 2023
- 稿件说明：
移动端阅览
高继蕊,李华锋,张亚飞等.双注意力引导的细节和结构信息融合图像去雾网络[J].电子学报,2023,51(01):160-171.

GAO Ji-rui,LI Hua-feng,ZHANG Ya-fei,et al.Dual Attention-Guided Detail and Structure Information Fusion Network for Image Dehazing[J].ACTA ELECTRONICA SINICA,2023,51(01):160-171.
高继蕊,李华锋,张亚飞等.双注意力引导的细节和结构信息融合图像去雾网络[J].电子学报,2023,51(01):160-171. DOI： 10.12263/DZXB.20211549.

GAO Ji-rui,LI Hua-feng,ZHANG Ya-fei,et al.Dual Attention-Guided Detail and Structure Information Fusion Network for Image Dehazing[J].ACTA ELECTRONICA SINICA,2023,51(01):160-171. DOI： 10.12263/DZXB.20211549.

摘要

雾图像结构信息弱化、边缘细节信息丢失，严重影响其在高水平视觉任务的使用.现有大部分去雾方法对图像细节信息的恢复并不理想，影响了图像去雾的整体效果.为此，本文提出一种双注意力引导的细节和结构信息融合去雾网络.该网络主要由空间-通道双注意力联合模块、细节和结构信息融合模块以及多尺度特征重建模块组成.其中，空间-通道双注意力联合模块通过联合空间和通道两个维度的注意力进行特征提取，实现雾图像中细节和结构信息的增强；细节和结构信息融合模块将结构信息和边缘细节信息融合为注意力权重和逆向注意力权重，以进一步增强这两种信息；多尺度特征重建模块将提取到的特征重建为清晰图像.实验结果表明，本文方法的去雾效果在定量评价和视觉效果上均优于对比方法.

Abstract

Haze weakens the structural information of an image and makes the edge information lost

which negatively affects the performance of high-level vision tasks. The details recovered by most existing dehazing methods are unsatisfactory

affecting the overall effect of image dehazing. To this end

this paper proposes a dual-attention guided detail and structure information fusion network composed of spatial-channel dual attention joint module

detail and structure information fusion module

and multi-scale feature reconstruction module. The spatial-channel dual attention joint module performs feature extraction by combining spatial attention and channel attention to enhance details and structural information in the hazy image. The detail and structure information fusion module fuses structure and edge into attention weights and inverse attention weights to further enhance both information. The multi-scale feature reconstruction module reconstructs the extracted features into a clear image. The experiment results show that the dehazing effect of the proposed method is superior to that of the compared methods in both quantitative evaluation and visual effect.

关键词

Keywords

references

PANG Y W , LI Y Z , SHEN J B , et al . Towards bridging semantic gap to improve semantic segmentation [C]// 2019 IEEE/CVF International Conference on Computer Vision . Seoul : IEEE , 2019 : 4229 - 4238 .

MA S , PANG Y , PAN J , et al . Preserving details in semantics-aware context for scene parsing [J]. Science China Information Sciences , 2020 , 63 ( 2 ): 120106 .

ZHANG Z J , PANG Y W . CGNet: Cross-guidance network for semantic segmentation [J]. Science China Information Sciences , 2020 , 63 ( 2 ): 120104 .

NIE J , ANWER R M , CHOLAKKAL H , et al . Enriched feature guided refinement network for object detection [C]// 2019 IEEE/CVF International Conference on Computer Vision . Seoul : IEEE , 2019 : 9536 - 9545 .

PANG Y W , XIE J , KHAN M H , et al . Mask-guided attention network for occluded pedestrian detection [C]// 2019 IEEE/CVF International Conference on Computer Vision . Seoul : IEEE, : 4966 - 4974 .

CAO J L , PANG Y W , HAN J G , et al . Hierarchical shot detector [C]// 2019 IEEE/CVF International Conference on Computer Vision . Seoul : IEEE , 2019 : 9704 - 9713 .

LI Y Z , PANG Y W , SHEN J B , et al . NETNet: Neighbor erasing and transferring network for better single shot object detection [C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Seattle : IEEE , 2020 : 13346 - 13355 .

NI W P , GAO X B , WANG Y . Single satellite image dehazing via linear intensity transformation and local property analysis [J]. Neurocomputing , 2016 , 175 : 25 - 39 .

MCCARTNEY E J , HALL F F . Optics of the atmosphere: Scattering by molecules and particles [J]. Physics Today , 1977 , 30 ( 5 ): 76 - 77 .

NARASIMHAN S G , NAYAR S K . Chromatic framework for vision in bad weather [C]// Proceedings IEEE Conference on Computer Vision and Pattern Recognition . Seattle : IEEE , 2020 : 598 - 605 .

NARASIMHAN S G , NAYAR S K . Vision and the atmosphere [J]. International Journal of Computer Vision , 2002 , 48 ( 3 ): 233 - 254 .

HE K M , SUN J , TANG X O . Single image haze removal using dark channel prior [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2011 , 33 ( 12 ): 2341 - 2353 .

ZHU Q S , MAI J M , SHAO L . A fast single image haze removal algorithm using color attenuation prior [J]. IEEE Transactions on Image Processing , 2015 , 24 ( 11 ): 3522 - 3533 .

BERMAN D , TREIBITZ T , AVIDAN S . Non-local image dehazing [C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition . Las Vegas : IEEE , 2016 : 1674 - 1682 .

CAI B L , XU X M , JIA K , et al . DehazeNet: An end-to-end system for single image haze removal [J]. IEEE Transactions on Image Processing , 2016 , 25 ( 11 ): 5187 - 5198 .

REN W , LIU S , ZHANG H , et al . Single image dehazing via multi-scale convolutional neural networks [C]// European Conference on Computer Vision . Amsterdam : Springer Cham , 2016 : 154 - 169 .

ZHANG H , PATEL V M . Densely connected pyramid dehazing network [C]// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Salt Lake City : IEEE , 2018 : 3194 - 3203 .

LI Y N , MIAO Q G , OUYANG W L , et al . LAP-Net: Level-aware progressive network for image dehazing [C]// 2019 IEEE/CVF International Conference on Computer Vision . Seoul : IEEE , 2019 : 3275 - 3284 .

REN W Q , MA L , ZHANG J W , et al . Gated fusion network for single image dehazing [C]// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Salt Lake City : IEEE , 2018 : 3253 - 3261 .

LIU X H , MA Y R , SHI Z H , et al . GridDehazeNet: Attention-based multi-scale network for image dehazing [C]// 2019 IEEE/CVF International Conference on Computer Vision . Seoul : IEEE , 2019 : 7314 - 7323 .

QU Y Y , CHEN Y Z , HUANG J Y , et al . Enhanced pix2pix dehazing network [C]// 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Long Beach : IEEE, : 8152 - 8160 .

QIN X , WANG Z L , BAI Y C , et al . FFA-Net: Feature fusion attention network for single image dehazing [C]// Proceedings of the AAAI Conference on Artificial Intelligence . New York : AAAI Press , 2020 : 11908 - 11915 .

DONG H , PAN J S , XIANG L , et al . Multi-scale boosted dehazing network with dense feature fusion [C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Seattle : IEEE , 2020 : 2154 - 2164 .

ZHANG X Q , JIANG R H , WANG T , et al . Single image dehazing via dual-path recurrent network [J]. IEEE Transactions on Image Processing , 2021 , 30 : 5211 - 5222 .

张登银 , 鞠铭烨 , 王雪梅 . 一种基于暗通道先验的快速图像去雾算法 [J]. 电子学报 , 2015 , 43 ( 7 ): 1437 - 1443 .

ZHANG D Y , JU M Y , WANG X M . A fast image daze removal algorithm using dark channel prior [J]. Acta Electronica Sinica , 2015 , 43 ( 7 ): 1437 - 1443 . (in Chinese)

刘杰平 , 黄炳坤 , 韦岗 . 一种快速的单幅图像去雾算法 [J]. 电子学报 , 2017 , 45 ( 8 ): 1896 - 1901 .

LIU J P , HUANG B K , WEI G . A fast effective single image dehazing algorithm [J]. Acta Electronica Sinica , 2017 , 45 ( 8 ): 1896 - 1901 . (in Chinese)

FATTAL R . Dehazing using color-lines [J]. ACM Transactions on Graphics , 2014 , 34 ( 1 ): 13 .

肖进胜 , 周景龙 , 雷俊锋 , 等 . 基于霾层学习的单幅图像去雾算法 [J]. 电子学报 , 2019 , 47 ( 10 ): 2142 - 2148 .

XIAO J S , ZHOU J L , LEI J F , et al . Single image dehazing algorithm based on the learning of hazy layers [J]. Acta Electronica Sinica , 2019 , 47 ( 10 ): 2142 - 2148 . (in Chinese)

SHAO Y J , LI L , REN W Q , et al . Domain adaptation for image dehazing [C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Seattle : IEEE , 2020 : 2805 - 2814 .

YU Y K , LIU H , FU M H , et al . A two-branch neural network for non-homogeneous dehazing via ensemble learning [C]// 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops . Nashville : IEEE , 2021 : 193 - 202 .

MNIH V , HEESS N , GRAVES A . Recurrent models of visual attention [C]// Proceedings of the 27th International Conference on Neural Information Processing Systems , Montreal : MIT Press , 2014 : 2204 - 2212 .

HE K M , ZHANG X Y , REN S Q , et al . Deep residual learning for image recognition [C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition . Las Vegas : IEEE , 2016 : 770 - 778 .

Fan D P , Ji G P , Zhou T , et al . PraNet: Parallel reverse attention network for polyp segmentation [C]// International Conference on Medical Image Computing and Computer Assisted Intervention . Lima : Springer , 2020 : 263 - 273 .

LI S L , ZHAO M , FANG Z Y , et al . Image super-resolution using lightweight multiscale residual dense network [J]. International Journal of Optics , 2020 , 2020 : 2852865 .

Simonyan K , Zisserman A . Very deep convolutional networks for large-scale image recognition [EB/OL]. ( 2015-04-10 )[ 2021-11-10 ]]. https://arxiv.org/abs/1409.1556v6 https://arxiv.org/abs/1409.1556v6 .

WANG Z , BOVIK A C , SHEIKH H R , et al . Image quality assessment: From error visibility to structural similarity [J]. IEEE Transactions on Image Processing , 2004 , 13 ( 4 ): 600 - 612 .

LI B Y , REN W Q , FU D P , et al . Benchmarking single-image dehazing and beyond [J]. IEEE Transactions on Image Processing , 2019 , 28 ( 1 ): 492 - 505 .

ZHANG Y F , DING L , SHARMA G . HazeRD: An outdoor scene dataset and benchmark for single image dehazing [C]// 2017 IEEE International Conference on Image Processing . Beijing : IEEE , 2017 : 3205 - 3209 .

Mannos J , Sakrison D . The effects of a visual fidelity criterion of the encoding of images [J]. IEEE Transactions on Information Theory , 1974 , 20 ( 4 ): 525 - 536 .

ZHANG R , ISOLA P , EFROS A A , et al . The unreasonable effectiveness of deep features as a perceptual metric [C]// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Salt Lake City : IEEE , 2018 : 586 - 595 .

Kingma D P , Ba J . Adam: A method for stochastic optimization [EB/OL].( 2014-10-22 )[ 2021-11-10 ]. https://arxiv.org/abs/1412.6980v9 https://arxiv.org/abs/1412.6980v9 .

HE T , ZHANG Z , ZHANG H , et al . Bag of tricks for image classification with convolutional neural networks [C]// 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Long Beach : IEEE , 2019 : 558 - 567 .

LI B Y , PENG X L , WANG Z Y , et al . AOD-net: All-in-one dehazing network [C]// 2017 IEEE International Conference on Computer Vision . Venice : IEEE , 2017 : 4780 - 4788 .

GAO Y Y , HU H M , LI B , et al . Detail preserved single image dehazing algorithm based on airlight refinement [J]. IEEE Transactions on Multimedia , 2019 , 21 ( 2 ): 351 - 362 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Cross-Layer Attention Feature Interaction and Multi-Scale Channel Attention Network for Single Image Dehazing

A Visual Grounding Method with Contrastive Learning Large Model

Image Dehazing Based on Gradient Guided Polarization Degree Estimation

Outdoor Image Dehazing Based on Multi-Order Channel Attention Calibration Using a Dual-Discriminator Heterogeneous CycleGAN Framework

Related Author

Ji-rui GAO

Hua-feng LI

Ya-fei ZHANG

Ming-hong XIE

Fan LI

SUN Hang

FU Qiu-yue

LI Bo-hui

Related Institution

Faculty of Information Engineering and Automation， Kunming University of Science and Technology

College of Computer and Information Technology, China Three Gorges University

Hubei Key Laboratory of Intelligent Vision Based Monitoring for Hydroelectric Engineering, China Three Gorges University

School of Information and Safety Engineering, Zhongnan University of Economics and Law

Graduate brigade, PLA Army Academy of Artillery and Air Defense

⁰