基于参数分步估计的红外与可见光图像自动配准算法

doi:10.3969/j.issn.0372-2112.2012.09.020

电子学报 ›› 2012, Vol. 40 ›› Issue (9): 1829-1838.DOI: 10.3969/j.issn.0372-2112.2012.09.020

基于参数分步估计的红外与可见光图像自动配准算法

廉蔺¹, 李国辉^1,2, 张军¹, 涂丹¹

1. 国防科学技术大学信息系统与管理学院系统工程系, 湖南长沙 410073;
2. 国防科学技术大学信息系统工程国防科技重点实验室, 湖南长沙 410073

收稿日期:2011-07-25 修回日期:2011-11-27 出版日期:2012-09-25
- 作者简介:
- 廉蔺 男,1983年生于河南漯河.国防科学技术大学信息系统与管理学院博士研究生.主要研究方向为视觉不变特征提取及描述,多传感器图像自动配准. E-mail:nudtlarry@gmail.com
- 基金资助:
- 国家自然科学基金 (No.60902093)

An Automatic Algorithm for Infrared and Visible Image Registration Based on Parameter Step Estimation

LIAN Lin¹, LI Guo-hui^1,2, ZHANG Jun¹, TU Dan¹

1. Department of System Engineering, School of Information System and Management, National University of Defense Technology, Changsha, Hunan 410073, China;
2. Science and Technology Foundation on Information System Engineering Laboratory, National University of Defense Technology, Changsha, Hunan 410073, China

Received:2011-07-25 Revised:2011-11-27 Online:2012-09-25 Published:2012-09-25
- Supported by:
- National Natural Science Foundation of China (No.60902093)

摘要/Abstract

摘要： 提出了一种仿射模型参数分步估计的红外与可见光图像自动配准算法.首先,使用矩阵正交分解方法,将仿射变换的6个自由度分离为易于估计的切变、尺度比例、旋转、尺度缩放以及x和y方向上的平移量等参数;然后基于方向一致性约束和线段间的对齐度分别构建用于参数分步估计的目标函数,并使用SGA(Stud Genetic Algorithm)算法搜索使目标函数取得近似全局最优解的参数值;最后,基于Powell算法对参数估计值进行局部求精.实验结果表明,当两幅需要配准的图像中含有丰富的关联线段及多样的线段方向分布时,本文算法能够利用这些线段间的方向一致性约束和位置分布信息,有效地实现红外与可见光图像的自动配准,且算法具有较好的配准精度.

关键词: 图像配准, 红外图像, 模型分解, 参数估计

Abstract: An automatic registration algorithm between infrared and visible images based on step estimation of affine model parameters is proposed.Firstly,the six degrees of freedom of the affine model are separated into some more easily estimated parameters using matrix orthogonal decomposition method,which are skew,scale ratio,rotation,scaling and translations in x and y directions.Secondly,two objective functions are constructed for step estimation of these parameters based on the orientation consensus constraint and alignment measure between segments,respectively,and parameter values which make objective function approximate the global optimum are obtained using SGA (Stud Genetic Algorithm) algorithm.Finally,the estimated values of the parameters are locally refined using Powell algorithm.The experimental results show that the proposed method can make full use of orientation consensus constraint and location distribution information of segments,and realize automatic registration between infrared and visible images efficiently and precisely on condition that two images to be registered contain abundant corresponding segments and diverse distributions of segment orientations.

Key words: image registration, infrared image, model decomposition, parameter estimation

中图分类号:

TP391

廉蔺, 李国辉, 张军, 等. 基于参数分步估计的红外与可见光图像自动配准算法[J]. 电子学报, 2012, 40(9): 1829-1838.

LIAN Lin, LI Guo-hui, ZHANG Jun, et al. An Automatic Algorithm for Infrared and Visible Image Registration Based on Parameter Step Estimation[J]. Acta Electronica Sinica, 2012, 40(9): 1829-1838.

参考文献

[1] Das S,Zhang Y.Color night vision for navigation and surveillance[J].Transportation Research Record,2000,1708(1):40-46.
[2] 李露,蒋宏,任章.红外与可见光复合寻的制导中的快速图像配准方法[J].哈尔滨工程大学学报,2009,30(2):228-232. LI Lu,JIANG Hong,REN Zhang.A fast image registration algorithm for compound IR/visible light homing guidance[J].Journal of Harbin Engineering University,2009,30(2):228-232.(in Chinese)
[3] 李光鑫,徐抒岩,董吉洪.结构优化型颜色传递融合方法[J].电子学报,2011,39(1):213-218. LI Guang-xin,XU Shu-yan,DONG Ji-hong.Architecture optimized version color transfer based fusion method[J].Acta Electronica Sinica,2011,39(1):213-218.(in Chinese)
[4] Loza A,Mihaylova L,Bull D,Canagarajah N.Structural similarity-based object tracking in multimodality surveillance videos[J].Machine Vision and Applications,2009,20(2):71-83.
[5] Stone H S,Wolpov R.Blind cross-spectral image registration using prefiltering and Fourier-based translation detection[J].IEEE Transactions on Geoscience and Remote Sensing,2002,40(3):637-650.
[6] Kern J P,Pattichis M S.Robust multispectral image registration using mutual-information models[J].IEEE Transactions on Geoscience and Remote Sensing,2007,45(5):1494-1505.
[7] Kim Y S,Lee J H,Ra J B.Multi-sensor image registration based on intensity and edge orientation information[J].Pattern Recognition,2008,41(11):3356-3365.
[8] Lee J H,Kim Y S,Lee D,Kang D G,Ra J B.Robust CCD and IR image registration using gradient-based statistical information[J].IEEE Signal Processing Letters,2010,17(4):347-350.
[9] Hrkac T,Kalafatic Z,Krapac J.Infrared-visual image registration based on corners and hausdorff distance. Proc of SCIA.07,Lecture Notes in Computer Sciences. Berlin:Springer-Verlag,2007.383-392.
[10] 高峰,文贡坚,吕金建.基于干线对的红外与可见光最优图像配准算法[J].计算机学报,2007,30(6):1014-1021. GAO Feng,WEN Gong-jian,LU Jin-jian.An optimal algorithm for IR/visual image registration based on main-line-pairs[J].Chinese Journal of Computers,2007,30(6):1014-1021.(in Chinese)
[11] 苏娟,林行刚,刘代志.一种基于结构特征边缘的多传感器图像配准方法[J].自动化学报,2009,35(3):251-257. SU Juan,LIN Xing-gang,LIU Dai-zhi.A multi-sensor image registration algorithm based on structure feature edges[J].Acta Automatica Sinica,2009,35(3):251-257.(in Chinese)
[12] Li H,Manjunath B S,Mitra S K.A contour-based approach to multisensor image registration[J].IEEE Transactions on Image Processing,1995,4(3):320-334.
[13] Coiras E,Santamaría J,Miravet C.A segment-based registration technique for visual-infrared images[J].Optical Engineering,2000,39(01):282-289.
[14] Keller Y,Averbuch A.Multisensor image registration via implicit similarity[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2006,28(5):794-801.
[15] Yao J,Goh K L.A refined algorithm for multisensor image registration based on pixel migration[J].IEEE Transactions on Image Processing,2006,15(7):1839-1847.
[16] 凌志刚,梁彦,程咏梅,潘泉,沈贺.一种稳健的多源遥感图像特征配准方法[J].电子学报,2010,38(12):2892-2897. LING Zhi-gang,LIANG Yan,CHENG Yong-mei,PAN Quan,SHEN He.A robust multi-source remote-sensing image registration method based on feature matching[J].Acta Electronica Sinica,2010,38(12):2892-2897.(in Chinese)
[17] Khatib W,Fleming P.The stud GA:A mini-revolution. Proceedings of the 5th International Conference on Parallel Problem Solving from Nature. London:Springer-Verlag,1998.683-691.
[18] Powell M J D.Nonlinear Optimization[M].London:Academic Press,1982.
[19] Shekhar C,Govindu V,Chellappa R.Multisensor image registration by feature consensus[J].Pattern Recognition,1999,32(1):39-52.
[20] Gioi R G V,Jakubowicz J,Morel J M,Randall G.LSD:A fast line segment detector with a false detection control[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2010,32(4):722-732.
[21] Chan Chi-ho.Matching Patterns of Line Segments Using Affine Invariant Features. Hong Kong:University of Hong Kong,2005.
[22] Simon D.Biogeography-based optimization[J].IEEE Transactions on Evolutionary Computation,2008,12(6):702-713.
[23] David D.Registered Visible and IR Surveillance Images. http://www.imagefusion.org/images/octec2,2011-10-20.

基于参数分步估计的红外与可见光图像自动配准算法

An Automatic Algorithm for Infrared and Visible Image Registration Based on Parameter Step Estimation

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	路皓翔, 刘振丙, 张静, 王子民. 结合多尺度循环卷积和多聚类空间的红外图像增强[J]. 电子学报, 2022, 50(2): 415-425.
[2]	位寅生, 周希波, 刘佳俊. 稳健的基于参数化协方差矩阵估计的空时自适应处理方法[J]. 电子学报, 2019, 47(9): 1943-1950.
[3]	袁晖坪. 泛延拓矩阵的QR分解[J]. 电子学报, 2019, 47(2): 308-313.
[4]	张行, 常颖, 宋康, 李春国, 杨绿溪. 一种新颖的水声信道参数估计算法[J]. 电子学报, 2019, 47(2): 509-512.
[5]	刘明骞, 郭菲, 李兵兵, 陈钱, 吴芸. Underlay认知网络中时频重叠OFDM信号的信噪比盲估计[J]. 电子学报, 2018, 46(6): 1510-1514.
[6]	贺雄鹏, 廖桂生, 许京伟, 魏嘉琪. 基于频率轴反转的机动目标距离徙动补偿方法[J]. 电子学报, 2018, 46(6): 1496-1502.
[7]	张俊林, 王彬, 汪洋, 刘明骞. 一种α稳定分布噪声下OFDM信号调制识别与参数估计算法[J]. 电子学报, 2018, 46(6): 1390-1396.
[8]	周则明, 胡彪, 孟勇, 陈超迁, 罗其祥. 基于流形特征与形状先验的红外直升机图像分割[J]. 电子学报, 2018, 46(4): 834-839.
[9]	周光兵, 宋华军, 吴玉兴, 任鹏. 一种非特征的3D图像快速刚性配准方法[J]. 电子学报, 2018, 46(10): 2384-2390.
[10]	张万, 刘刚, 朱凯, 廖恒旭. 基于多参数配准模型的脑核磁影像分割算法[J]. 电子学报, 2017, 45(9): 2202-2209.
[11]	陈鑫, 刘振, 魏玺章. 基于旋转均匀圆阵的单近场源参数估计解模糊算法[J]. 电子学报, 2017, 45(3): 584-590.
[12]	张华美, 张业荣, 王芳芳. 墙体参数未知时的穿墙雷达实时成像方法[J]. 电子学报, 2016, 44(7): 1613-1618.
[13]	钟金荣, 文贡坚. GTD模型参数估计的时域稀疏成分分析法[J]. 电子学报, 2016, 44(6): 1336-1342.
[14]	王慧武, 丛超. 一种基于Duffing系统的信号检测与参数估计新方法[J]. 电子学报, 2016, 44(6): 1450-1457.
[15]	闫利, 向天烛. NSCT域内结合边缘特征和自适应PCNN的红外与可见光图像融合[J]. 电子学报, 2016, 44(4): 761-766.