DRHA-UIE: An Underwater Image Enhancement Method Based on Dual Residual Hybrid Attention Block

WANG Xin; SHI Hui

doi:10.12263/DZXB.20211619

您当前的位置：

首页 >

文章列表页 >

DRHA-UIE: An Underwater Image Enhancement Method Based on Dual Residual Hybrid Attention Block

PAPERS | 更新时间：2025-12-08

- DRHA-UIE: An Underwater Image Enhancement Method Based on Dual Residual Hybrid Attention Block
- ACTA ELECTRONICA SINICA Vol. 51, Issue 9, Pages: 2398-2407(2023)
- 作者机构：
  
  吉林大学计算机科学与技术学院，吉林长春 130000
- 作者简介：
- 基金信息：
  
  Scientific and Technological Research Foundation of the Education Department of Jilin Province, China(JJKH20211100KJ)
- DOI：10.12263/DZXB.20211619
  CLC： TP391
- Received：03 December 2021，
  
  Revised：2022-04-09，
  
  Published：25 September 2023
- 稿件说明：
移动端阅览
王欣,石慧.DRHA-UIE：基于双重残差混合注意力模块的水下图像增强方法[J].电子学报,2023,51(09):2398-2407.

WANG Xin,SHI Hui.DRHA-UIE: An Underwater Image Enhancement Method Based on Dual Residual Hybrid Attention Block[J].ACTA ELECTRONICA SINICA,2023,51(09):2398-2407.
王欣,石慧.DRHA-UIE：基于双重残差混合注意力模块的水下图像增强方法[J].电子学报,2023,51(09):2398-2407. DOI： 10.12263/DZXB.20211619.

WANG Xin,SHI Hui.DRHA-UIE: An Underwater Image Enhancement Method Based on Dual Residual Hybrid Attention Block[J].ACTA ELECTRONICA SINICA,2023,51(09):2398-2407. DOI： 10.12263/DZXB.20211619.

摘要

在水下环境中，悬浮的颗粒会对光造成散射和波长相关的衰减，使水下图像呈现出颜色失真、对比度低等问题．针对上述问题，本文提出一种基于双重残差混合注意力模块的水下图像增强方法（Dual Residual Hybrid Attention Underwater Image Enhancement method，DRHA-UIE）．该方法采用改进的双重残差块完成特征学习，并通过在双重残差块中引入混合注意力模块，沿通道和空间两个维度对特征进行注意力权重推断，以捕获显著特征．本文设计结合像素级损失、结构相似性损失和内容感知损失的联合特征损失函数，以获得具有更精细纹理的增强图像．此外，本文应用水下图像形成模型（Image Formation Model，IFM）对水下图像基准数据集（Underwater Image Enhancement Benchmark dataset，UIEB）进行优化，获得了具有更高视觉质量的N-UIEB（New-UIEB）数据集，实验表明，相较于UIEB数据集，基于N-UIEB训练得到的增强图像具有更自然的颜色和更清晰的细节．为验证本文方法的有效性，将本文方法与主流的10种方法进行测试和比较，结果表明，DRHA-UIE方法有效提高了图像对比度并恢复了图像颜色，在与水下图像增强算法的定量比较中获得了最优的性能．

Abstract

In seawater

light suffers from scattering and wavelength-related attenuation

which makes underwater images exhibit color distortion and low contrast. In this paper

we propose a robust method called dual residual hybrid attention underwater image enhancement method (DRHA-UIE). The proposed method uses an improved dual residual block for features learning. To capture the significant features

a hybrid attention mechanism is introduced in the dual residual block

which infers the attention weights on the features along the channel and spatial dimensions. To train the proposed method end-to-end

a joint feature loss function that consists of pixel-level loss

structural similarity loss

and content-aware loss is designed

then enhanced images with finer textures are obtained. In addition

a revised underwater image formation model (IFM) is applied to optimize the underwater image enhancement benchmark dataset (UIEB)

and a dataset with higher visual quality

new-underwater image enhancement benchmark dataset (N-UIEB)

is obtained. Experiments show that the enhanced images trained by N-UIEB have more natural colors and sharper details than those trained by the UIEB dataset. The proposed model is extensively evaluated on the above two datasets. Results show that the DRHA-UIE method effectively enhances the image quality subjectively and outperforms the other 10 state-of-the-art methods in quantitative comparisons.

关键词

Keywords

references

JOHNSON-ROBERSON M , BRYSON M , FRIEDMAN A , et al . High-resolution underwater robotic vision-based mapping and three-dimensional reconstruction for archaeology [J]. Journal of Field Robotics , 2017 , 34 ( 4 ): 625 - 643 .

BRYSON M , JOHNSON-ROBERSON M , PIZARRO O , et al . Automated registration for multi-year robotic surveys of marine benthic habitats [C]// 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems . Tokyo : IEEE , 2013 : 3344 - 3349 .

HAN M , LYU Z Y , QIU T , et al . A review on intelligence dehazing and color restoration for underwater images [J]. IEEE Transactions on Systems, Man, and Cybernetics: Systems , 2018 , 50 ( 5 ): 1820 - 1832 .

ANCUTI C , ANCUTI C O , HABER T , et al . Enhancing underwater images and videos by fusion [C]// 2012 IEEE Conference on Computer Vision and Pattern Recognition . Piscataway : IEEE , 2012 : 81 - 88 .

FU X Y , ZHUANG P X , HUANG Y , et al . A retinex-based enhancing approach for single underwater image [C]// 2014 IEEE International Conference on Image Processing (ICIP) . Paris : IEEE , 2014 : 4572 - 4576 .

GALDRAN A , PARDO D , PICÓN A , et al . Automatic red-channel underwater image restoration [J]. Journal of Visual Communication and Image Representation , 2015 , 26 : 132 - 145 .

LI C Y , GUO J C , CONG R M , et al . Underwater image enhancement by dehazing with minimum information loss and histogram distribution prior [J]. IEEE Transactions on Image Processing , 2016 , 25 ( 12 ): 5664 - 5677 .

DREWS P L J J , NASCIMENTO E R , BOTELHO S S C , et al . Underwater depth estimation and image restoration based on single images [J]. IEEE Computer Graphics and Applications , 2016 , 36 ( 2 ): 24 - 35 .

HE K M , SUN J , TANG X O . Single image haze removal using dark channel prior [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2011 , 33 ( 12 ): 2341 - 2353 .

PENG Y T , COSMAN P C . Underwater image restoration based on image blurriness and light absorption [J]. IEEE Transactions on Image Processing , 2017 , 26 ( 4 ): 1579 - 1594 .

AKKAYNAK D , TREIBITZ T . Sea-thru: A method for removing water from underwater images [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Long Beach : IEEE , 2019 : 1682 - 1691 .

LI C Y , GUO C L , REN W Q , et al . An underwater image enhancement benchmark dataset and beyond [J]. IEEE Transactions on Image Processing , 2020 , 29 : 4376 - 4389 .

LI J , SKINNER K A , EUSTICE R M , et al . WaterGAN: Unsupervised generative network to enable real-time color correction of monocular underwater images [J]. IEEE Robotics and Automation letters , 2018 , 3 ( 1 ): 387 - 394 .

FABBRI C , ISLAM M J , SATTAR J . Enhancing underwater imagery using generative adversarial networks [C]// 2018 IEEE International Conference on Robotics and Automation (ICRA) . Brisbane : IEEE , 2018 : 7159 - 7165 .

IISLAM M J , XIA Y Y , SATTAR J . Fast underwater image enhancement for improved visual perception [J]. IEEE Robotics and Automation Letters , 2020 , 5 ( 2 ): 3227 - 3234 .

NAIK A , SWARNAKAR A , MITTAL K . Shallow-UWnet: Compressed model for underwater image enhancement (student abstract) [J]. Proceedings of the AAAI Conference on Artificial Intelligence , 2021 , 35 ( 18 ): 15853 - 15854 .

LI C Y , ANWAR S , PORIKLI F . Underwater scene prior inspired deep underwater image and video enhancement [J]. Pattern Recognition , 2020 , 98 : 107038 .

WU S C , LUO T , JIANG G Y , et al . A two-stage underwater enhancement network based on structure decomposition and characteristics of underwater imaging [J]. IEEE Journal of Oceanic Engineering , 2021 , 46 ( 4 ): 1213 - 1227 .

肖进胜 , 周景龙 , 雷俊锋 , 等 . 基于霾层学习的单幅图像去雾算法 [J]. 电子学报 , 2019 , 47 ( 10 ): 2142 - 2148 .

XIAO J S , ZHOU J L , LEI J F , et al . Single image dehazing algorithm based on the learning of hazy layers [J]. Acta Electronica Sinica , 2019 , 47 ( 10 ): 2142 - 2148 . (in Chinese)

盖杉 , 王俊生 . 基于深度学习的非局部注意力增强网络图像去雨算法研究 [J]. 电子学报 , 2020 , 48 ( 10 ): 1899 - 1908 .

GAI S , WANG J S . Image raindrop algorithm research using nonlocal attention enhanced network based on deep learning [J]. Acta Electronica Sinica , 2020 , 48 ( 10 ): 1899 - 1908 . (in Chinese)

SHI W Z , CABALLERO J , HUSZÁR F , et al . Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Las Vegas : IEEE , 2016 : 1874 - 1883 .

SUGANUMA M , OZAY M , OKATANI T . Exploiting the potential of standard convolutional autoencoders for image restoration by evolutionary search [EB/OL]. ( 2018-03-01 ). https://arxiv.org/abs/1803.00370 https://arxiv.org/abs/1803.00370 .

LIU X , SUGANUMA M , SUN Z , et al . Dual residual networks leveraging the potential of paired operations for image restoration [C]// 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE , 2020 : 7000 - 7009 .

HU J , SHEN L , SUN G . Squeeze-and-excitation networks [C]// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway : IEEE , 2018 : 7132 - 7141 .

WOO S , PARK J , LEE J Y , et al . CBAM: Convolutional block attention module [C]// Proceedings of the European Conference on Computer Vision . Berlin : Springer , 2018 : 3 - 19 .

WANG Z , BOVIK A C , SHEIKH H R , et al . Image quality assessment: From error visibility to structural similarity [J]. IEEE Transactions on Image Processing , 2004 , 13 ( 4 ): 600 - 612 .

AKKAYNAK D , TREIBITZ T . A revised underwater image formation model [C]// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway : IEEE , 2018 : 6723 - 6732 .

GODARD C , MAC AODHA O , FIRMAN M , et al . Digging into self-supervised monocular depth estimation [C]// 2019 IEEE/CVF International Conference on Computer Vision (ICCV) . Piscataway : IEEE , 2020 : 3827 - 3837 .

PANETTA K , GAO C , AGAIAN S . Human-visual-system-inspired underwater image quality measures [J]. IEEE Journal of Oceanic Engineering , 2015 , 41 ( 3 ): 541 - 551 .

YANG M , SOWMYA A . An underwater color image quality evaluation metric [J]. IEEE Transactions on Image Processing , 2015 , 24 ( 12 ): 6062 - 6071 .

LI C Y , ANWAR S , Hou J H , et al . Underwater image enhancement via medium transmission-guided multi-color space embedding [J]. IEEE Transactions on Image Processing , 2021 , 30 : 4985 - 5000 .

QIN X , WANG Z L , BAI Y C , et al . FFA-Net: Feature fusion attention network for single image dehazing [J]. Proceedings of the AAAI Conference on Artificial Intelligence , 2020 , 34 ( 7 ): 11908 - 11915 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Survey of Object Detection Based on Deep Learning

Continual Learning Methods and Applications in Computer Vision

Neural Network Based Image Style Transfer: A Survey

MalMKNet: A Multi-Scale Convolutional Neural Network Used for Malware Classification

Related Author

LUO Hui-lan

CHEN Hong-kun

FANG Yan

Wei Yun-chao

Cong Run-min

Zuo Wang-meng

Zhao Yao

WANG Wei

Related Institution

School of Information Engineering, Jiangxi University of Science and Technology

School of Computer Science and Technology, Beijing Jiaotong University

School of Control Science and Engineering, Shandong University

School of Computer Science and Technology, Harbin Institute of Technology

School of Computer Science and Technology, Beijing Jiaotong University

⁰