结合多尺度循环卷积和多聚类空间的红外图像增强
Infrared Image Enhancement Based on Multi-Scale Cyclic Convolution and Multi-Clustering Space
- 电子学报 2022年50卷第2期 页码：415-425
- 作者机构：
1.桂林电子科技大学计算机与信息安全学院，广西桂林 541004
2.桂林电子科技大学商学院，广西桂林 541004
- 作者简介：
[ "路皓翔 男，1991年10月生，河南安阳人.博士研究生.主要研究方向为图像处理、深度学习.E-mail: 646510477@qq.com" ]
[ "刘振丙（通讯作者） 男，1980年6月生，广西桂林人.博士、教授，博士生导师.主要研究方向为医学图像处理、深度学习." ]
- 基金信息：国家自然科学基金(61866009;61906050);广西重点研发项目(2017GXNSFDA198025);广西创新驱动重大专项(AA17202024)
DOI：10.12263/DZXB.20210177
中图分类号： TP391收稿：2021-01-27，
修回：2021-09-29，
纸质出版：2022-02-25
- 稿件说明：
移动端阅览
路皓翔,刘振丙,张静等.结合多尺度循环卷积和多聚类空间的红外图像增强[J].电子学报,2022,50(02):415-425.
LU Hao-xiang,LIU Zhen-bing,ZHANG Jing,et al.Infrared Image Enhancement Based on Multi-Scale Cyclic Convolution and Multi-Clustering Space[J].ACTA ELECTRONICA SINICA,2022,50(02):415-425.
路皓翔,刘振丙,张静等.结合多尺度循环卷积和多聚类空间的红外图像增强[J].电子学报,2022,50(02):415-425. DOI： 10.12263/DZXB.20210177.
LU Hao-xiang,LIU Zhen-bing,ZHANG Jing,et al.Infrared Image Enhancement Based on Multi-Scale Cyclic Convolution and Multi-Clustering Space[J].ACTA ELECTRONICA SINICA,2022,50(02):415-425. DOI： 10.12263/DZXB.20210177.
摘要
红外图像低对比度、低亮度及轮廓细节模糊等问题限制了红外成像技术的应用.为了提高红外图像的质量，本文提出了一种结合多尺度循环卷积和多聚类空间红外图像增强方法，该方法分为五个阶段：多尺度循环卷积、多聚类空间混合均衡化、多角度组合滤波器、线性融合和图像层次化处理.其中，通过多尺度循环卷积和多角度组合滤波器增强图像细节及轮廓信息；多聚类空间混合均衡化通过改进的K-means对图像灰度值进行聚类分析，依据图像特性选取不同的均衡化方式提升图像对比度及亮度；图像层次化处理用于提升图像清晰度.结果表明：与对比方法相比，该方法能够显著增强红外图像细节及轮廓，提升红外图像对比度和亮度.
Abstract
Infrared image has problems of low contrast
low brightness and blurring of contour details
limiting the application of the infrared imaging technology. To improve the quality of infrared image
an infrared image enhancement method based on multi-scale cyclic convolution and multi-clustering space is proposed. The method contains five stages: multi-scale cyclic convolution
hybrid equalization in the clustering space
multi-angle combination filter
linear fusion
and image hierarchical processing. The details and contour information of the image are enhanced by multi-scale cyclic convolution and multi-angle combination filter
and the hybrid equalization of the clustering space performs clustering analysis on the image gray value through the improved K-means. According to the image characteristics
different equalization methods are selected to improve the contrast and brightness of the image. The hierarchical processing of image is used to improve clarity of the image. Experimental results show that the proposed method not only can improve the details and contour of infrared image
but also can enhance the contrast and brightness of infrared image compared with the contrast method.
关键词
Keywords
references
RAMSEY M S , FLYNN I T W . The spatial and spectral resolution of ASTER infrared image data: Aparadigm shift in volcanologicalremote sensing [J]. Remote Sensing , 2020 , 12 ( 4 ): 738 - 747 .
武魁军 , 何微微 , 于光保 , 等 . 分子滤光红外成像技术及其在光电探测中的应用 [J]. 红外与激光工程 , 2019 , 48 ( 4 ): 22 - 30 .
WU Kui-jun , HE Wei-wei , YU Guang-bao , et al . Molecular filter infrared imaging technology and its application in photoelectric detection [J]. Infrared and Laser Engineering , 2019 , 48 ( 4 ): 22 - 30 . (in Chinese)
陈欣欣 , 刘子毅 , 吕美巧 , 等 . 基于热红外成像技术的油菜菌核病早期检测研究 [J]. 光谱学与光谱分析 , 2019 , 39 ( 3 ): 730 - 737 .
CHEN Xin-xin , LIU Zi-yi , LV Mei-qiao , et al . Diagnosis and monitoring of sclerotinia stem rot of oilseed rape using thermal infrared imaging [J]. Spectroscopy and Spectral Analysis , 2019 , 39 ( 3 ): 730 - 737 . (in Chinese)
张智韬 , 边江 , 韩文霆 , 等 . 无人机热红外图像计算冠层温度特征数诊断棉花水分胁迫 [J]. 农业工程学报 , 2018 , 34 ( 15 ): 77 - 84 .
ZHANG Zhi-tao , BIAN Jiang , HAN Wen-ting , et al . Cotton moisture stress diagnosis based on canopy temperaturecharacteristics calculated from UAV thermal infrared image [J]. Transactions of the Chinese Society of Agricultural Engineering , 2018 , 34 ( 15 ): 77 - 84 . (in Chinese)
VERHOGLYAD A G , SOLDATENKO A V , ELESIN A G , et al . Certification of a two-channel automated infrared image synthesis system for testing array photodetectors [J]. Measurement Techniques , 2020 , 63 ( 1 ): 281 - 287 .
ZHANG S , LIU F . Infrared and visible image fusion based on non-subsampled shearlet transform, regional energy, and co-occurrence filtering [J]. Electronics Letters , 2020 , 56 ( 15 ): 761 - 764 .
李佳 , 李少娟 , 段小虎 , 等 . 基于Retinex理论与概率非局部均值的红外图像增强方法 [J]. 光子学报 , 2020 , 49 ( 4 ): 0410003 .
LI Jia , LI Shao-juan , DUAN Xiao-hu , et al . Infrared image enhancement based on retinex and probability nonlocal means filtering [J]. Acta Photonica Sinica , 2020 , 49 ( 4 ): 0410003 . (in Chinese)
BAKHSHI G , SHAHTALEBI K , MOMENI M . A new adaptive algorithm for target detection in hyperspectral images [J]. Infrared Physics & Technology , 2019 , 99 : 222 - 230 .
WANG K , LI S , NIU S , et al . Detection of infrared small targets using feature fusion convolutional network [J]. IEEE Access , 2019 , 7 ( 99 ): 146081 - 146092 .
戴声奎 , 钟峥 , 等 . 基于最大熵模型的双直方图均衡算法 [J]. 电子学报 , 2019 , 47 ( 3 ): 678 - 685 .
DAI Sheng-kui , ZHONG Zheng , et al . Maximum entropy model based bi-histogram equalization algorithm [J]. Acta Electronica Sinica , 2019 , 47 ( 3 ): 678 - 685 . (in Chinese)
宋伟 , 任栋 , 于京 , 等 . 一种新的基于三维卷积共生梯度直方图和多示例学习的特殊视频检测算法 [J]. 计算机学报 , 2019 , 42 ( 1 ): 151 - 165 .
SONG Wei , REN Dong , YU Jing . A new special video detection algorithm based on 3D convolution CoHOG and MIL [J]. Chinese Journal of Computers , 2019 , 42 ( 1 ): 151 - 165 . (in Chinese)
PARIHAR A S , VERMA O P , KHANNA C . Fuzzy-contextual contrast enhancement [J]. IEEE Transactions on Image Processing , 2017 , 26 ( 4 ): 1810 - 1819 .
ACHARYA K , GHOSHAL D . Contrast enhancement of images through skewness and mode based bi-histogram equalization [J]. International Journal of Image, Graphics and Signal Processing , 2020 , 12 ( 5 ): 13 - 27 .
SINGH H , KUMAR A , BALYAN L K , et al . Optimally sectioned and successively reconstructed histogram sub-equalization based gamma correction for satellite image enhancement [J]. Multimedia Tools and Applications , 2019 , 78 ( 14 ): 20431 - 20463 .
ABDULLAH A W M , KABIR M H , DEWAN M A A , et al . A dynamic histogram equalization for image contrast enhancement [J]. IEEE Transactions on Consumer Electronics , 2007 , 53 ( 2 ): 593 - 600 .
BOYINA S R . Dynamic histogram equalization for contrast enhancement for digital images [J]. Applied Soft Computing , 2020 , 89 : 106114 .
BHANDARI A K , KANDHWAY P , MAURYA S . Salpswarm algorithm based optimally weighted histogram framework for image enhancement [J]. IEEE Transactions on Instrumentation and Measurement , 2020 , 69 ( 6 ): 6807 - 6815 .
FAN H Y , LU Z M , LIU Y L . A low-frequency construction watermarking based on histogram [J]. Multimedia Tools and Applications , 2020 , 79 ( 9 ): 5693 - 5717 .
ALFRED C , FARRISA K , YING W L . Histogram-free multicanonical Monte Carlo sampling to calculate the density of states [J]. Computer Physics Communications , 2019 , 235 : 297 - 304 .
肖昌炎 , 邱华林 , 赵宏 , 等 . 低对比度叠层薄片的机器视觉计数测量方法 [J]. 湖南大学学报(自然科学版) , 2018 , 292 ( 4 ): 127 - 133 .
XIAO Chang-yan , QIU Hua-lin , ZHAO Hong , et al . A count measurement method for low contrast stacked sheets in machine vision [J]. Journal of Hunan University(Natural Sciences) , 2018 , 292 ( 4 ): 127 - 133 . (in Chinese)
FU X , CAO X . Underwater image enhancement with global-local networks and compressedhistogram equalization [J]. Signal Processing: Image Communication , 2020 , 86 : 115892 .
MONTAZERI M . Memetic algorithm image enhancement for preserving mean brightness without losing image features [J]. International Journal of Image and Graphics , 2019 , 19 ( 4 ): 1950020 .
PAPADAKIS N , PROVENZI E , CASELLES V . A variational model for histogram transfer of color images [J]. IEEE Transactions on Image Processing , 2011 , 20 ( 6 ): 1682 - 1690 .
杨爱萍 , 王海新 , 王金斌 , 等 . 基于透射率融合与多重导向滤波的单幅图像去雾 [J]. 光学学报 , 2019 , 38 ( 12 ): 104 - 114 .
YANG Ai-ping , WANG Hai-xin , WANG Jin-bin , et al . Image dehazing based on transmission fusion and multi-guided filtering [J]. Acta Optica Sinica , 2019 , 38 ( 12 ): 104 - 114 . (in Chinese)
BRANCHITTA F , DIANI M , CORSINI G , et al . New technique for the visualization of high dynamic range infrared images [J]. Optical Engineering , 2009 , 48 ( 9 ): 096401 .
BAE T , KIM Y , AHN S . IR-band conversion of target and background using surface temperature estimation and error compensation for military IR sensor simulation [J]. Sensors , 2019 , 19 ( 11 ): 2455 - 2467 .
GOPINATHAH S , YAMIN S . A study on color image enhancement technique of fusion using automated histogram specification [J]. International Journal of Computer Applications , 2019 , 182 ( 41 ): 24 - 29 .
KAURA A , SINGH C . Contrast enhancement for cephalometric images using wavelet-based modified adaptive histogram equalization [J]. Applied Soft Computing , 2017 , 51 : 180 - 191 .
LUO W , XUE Q , ZHANG Y , et al . Enhancing sketch-based image retrieval by CNN semantic re-ranking [J]. IEEE Transactions on Cybernetics , 2019 , 50 ( 7 ): 3330 - 3342 .
TU Z , XIE W , DAUWELS J , et al . Semantic cues enhanced multi-modality multi-stream CNN for action recognition [J]. IEEE Transactions on Circuits and Systems for Video Technology , 2018 , 29 ( 99 ): 1423 - 1437 .
TONG W , CHEN W , HAN W , et al . Channel attention based densenet network for remote sensing image scene classification [J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing , 2020 , 13 : 4121 - 4132 .
ATISH C , CHAUDHARY A , VANDANA F , et al . An efficient method for brain tumor detection and categorization using mri images by k-means clustering & DWT [J]. International Journal of Information Technology , 2020 , 12 ( 1 ): 141 - 148 .
HU BB , LI H J . Gray image enhancement based on improved histogram equalization and SSR algorithm [J]. Chinese Journal of Quantum Electronics , 2017 , 34 ( 3 ): 286 - 292 .
ZAHEERUDDIN S , SUGANTHI K . Image contrast enhancement by homomorphic filtering based parametric fuzzy transform [J]. Procedia Computer Science , 2019 , 165 : 166 - 172 .
KIM Y T . Contrast enhancement using brightness preserving bi-histogram equalization [J]. IEEE Transactions on Consumer Electronics , 1997 , 43 ( 1 ): 1 - 8 .
董丽丽 , 丁畅 , 许文海 . 基于直方图均衡化图像增强的两种改进方法 [J]. 电子学报 , 2018 , 46 ( 10 ): 2367 - 2375 .
DONG Li-li , DING Chang , XU Wen-hai . Two improved methods based on histogram equalization for image enhancement [J]. Acta Electronica Sinica , 2018 , 46 ( 10 ): 2367 - 2375 . (in Chinese)
SINGH K , VISHWAKARMA D K , Walia G S , et al . Contrast enhancement via texture region based histogram equalization [J]. Journal of Modern Optics , 2016 , 63 ( 15 ): 1444 - 1450 .
0
浏览量
20
下载量
4
CSCD
- 网络PDF下载
- Meta-XML下载
- BibTeX下载
- Endnote下载
- RefMan 下载
- NoteExpress下载
- NoteFirst下载
关联资源
相关文章
相关作者
相关机构
- 技术支持由北京北大方正电子有限公司提供 京ICP备09064830号-19
京公网安备11010802024621 - 本系统建议在Chrome、 IE9+ 以上版本浏览器阅读本站内容，360浏览器请切换至极速模式
- Cookies帮助我们提供服务并提供个性化体验。使用本网站，即表示您同意我们使用Cookies