Cooperation between Fusion and Segmentation for Multisource Image
CHEN Rong-yuan1,2, ZHENG Chen3, SHEN Li-Zhi1, LI Guang-Qiong1, TAN Li-Na1
1. School of computer and Information Engineering, Hunan University of Commerce, Changsha, Hunan 410205, China;
2. School of Computer, National University of Defense Technology, Changsha, Hunan, 410073, China;
3. School of Mathematics and Information Sciences, Henan University, Kaifeng, Henan, 475000, China
In order to solve the problem that lack of coordination between image fusion and segmentation methods.A cooperation framework for multisource remote sensing images fusion and segmentation was proposed in view of the advantage that data assimilation system can integrate its model operator and observation operator, and it can be optimized itself.Under this framework, two fusion methods based on contrast Pyramid transform and nonsubsampled contourlet transform were used as model operator and observation operator, the objective function was composed of probabilistic rand index to evaluate segmentation effect and particle swarm optimization with crossover operator was employed.The framework can adaptively adjust the parameters of segmentation algorithm according to fused images, and can use the segmentation results to guide the optimization of fused images, so as to make image fusion and image segmentation cooperate with each other.Two groups of experiments validate the effectiveness of the framework.
陈荣元, 郑晨, 申立智, 李广琼, 谭利娜. 多源影像融合与分割的协同方法[J]. 电子学报, 2015, 43(10): 1994-2000.
CHEN Rong-yuan, ZHENG Chen, SHEN Li-Zhi, LI Guang-Qiong, TAN Li-Na. Cooperation between Fusion and Segmentation for Multisource Image. Chinese Journal of Electronics, 2015, 43(10): 1994-2000.
[1] 田养军,薛春纪,马智民,曹建农.曲波变换的高光谱遥感图像融合方法在土地利用调查中的应用[J].遥感学报,2009,13(2):313-319. TIAN Yang-jun,XUE Chun-ji,MA Zhi-min,CAO Jian-nong.Image fusion algorithm of the hyperspectral remote sensing appling to the survey of land utilization based on a curvaturewave transformation[J].Journal of Remote Sensing,2009,13(2):313-319 (in Chinese)
[2] S.Hailiang,F.Min.Multi-focus Color Image Fusion Based on SWT and IHS[C].In:Conference Fourth International Conference on Fuzzy Systems and Knowledge Discovery.2007.2:461-465.
[3] M.González-Audícana,J.L.Saleta,R.G.Catalán,R.García.Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition[J].IEEE Transactions on Geoscience and Remote Sensing,2004,42(6):1291-1299.
[4] S.A.Valizadeh,H.Ghassemian.Remote Sensing Image Fusion Using Combining IHS and Curvelet Transform.2012 Sixth International Symposium on Telecommunications.Tehran Iran:IEEE Conference Publications,2012:1184-1189.
[5] Z.Xingwang,L.Xiangui.Pixel level image fusion scheme based on accumulated gradient and PCA transform[C].In:Conference 2008 9th International Conference on Computer-Aided Industrial Design and Conceptual Design.2008:594-598.
[6] N.Cvejic,D.Bull,N.Canagarajah.Region-Based Multimodal Image Fusion Using ICA Bases[J].IEEE Sensors Journal,2007,7(5):743-751.
[7] 江铁,朱桂斌,孙奥.基于金字塔变换的多曝光图像融合[J].计算机技术与发展,2013,23(1):95-98. JIANG Tie,ZHU Gui-bin,SUN Ao.Multi-exposure Image Fusion Based on Pyramid ransformation[J].Computer Technology and Development,2013,23(1):95-98(in Chinese)
[8] C.Yao,K.Lei.Multi-sensor Image Fusion Algorithm Based on NSCT and PCNN[C].In:Conference 2010 International Conference on Computational Aspects of Social Networks Taiyuan,China 2010:105-108
[9] 蒋卫国,陈云浩,李京,崔保山.一种基于Contourlet域隐马尔可夫树模型的遥感影像融合方法[J].红外与毫米波学报,2008,27(4):285-289. DENG Lei,JIANG Wei-Guo,CHEN Yun-Hao,LI Jing,CUI Bao-Shan.Remote Sensing Iamge Fusion Method Based On Contourlet-Domain Hidden Marvov Tree Model[J].J.Infrared Millin.Waves,,2008,27(4):285-289(in Chinese)
[10] 李晖晖,郭雷,刘航.基于区域分割的遥感图像融合方法[J].光子学报,2005,34(12):1901-1905. Li Huihui,Guo Lei,Liu Hang.A Region-based Remote Sensing Image Fusion Method[J]. ACTA PHOTONICA SINICA,2005,34(12):1901-1905.(in Chinese)
[11] K.Saha,P.Shah,S.N.Merchant,U.B.Desai.A novel multi-focus image fusion algorithm using edge information and K-mean segmentation[C].In:Conference th International Conference on Information,Communications and Signal Processing.2009:1-5.
[12] 王跃山.数据同化——它的缘起、含义和主要方法[J].海洋预报,1999,16(1):11-20. Wang Yao-Shan.Data assimilation-its cause,its meaning and main procedures.Marine Forecasts,1999.16(1):11-20(in Chinese)
[13] 金海燕,刘芳,焦李成.基于多尺度对比度塔和方向滤波器组的图像融合[J].电子学报,2007,35(7):1295-1300. JIN Hai-yan,LIU Fang,JIAO Li-cheng.A Method of Image Fusion Based on Multiscale Contrast Pyramid and Directional Filter Banks[J].ACTA ELECTRONICA SINICA,2007,35(7):1295-1300(in Chinese)
[14] 王文波,李合龙,张晓东.联合非降采样金字塔与经验模态分解的遥感图像融合算法[J].哈尔滨工程大学学报,2012,33(11):1394-1398. WANG Wenbo,LI Helong,ZHANG Xiaodong.Fusion algorithm of remote sensing images based on nonsubsampled pyramid and empirical mode demoposition[J].Journal of Harbin Engineering University,2012,33(11):1394-1398.(in Chinese)
[15] 金星,李晖晖,时丕丽.非下采样Contourlet变换与脉冲耦合神经网络相结合的SAR与多光谱图像融合[J].中国图象图形学报,2012,(09):1188-1195. Jin Xing,Li Huihui,Shi Pili.SAR and multispectral image fusion algorithm based on pulse coupled neural networks and non-subsampled Contourlet transform[J].Journal of Image and Graphics,2012,(09):1188-1195.(in Chinese)
[16] Y.Xiao-Hui,J.Li-Cheng.Fusion Algorithm for Remote Sensing Images Based on Nonsubsampled Contourlet Transform[J].ACTA AUTOMATICA SINICA,2008,34(3):274-281.
[17] 王雷光,刘国英,梅天灿,秦前清.一种光谱与纹理特征加权的高分辨率遥感纹理分割算法[J].光学学报,2009,29(11):3010-3017. Wang Leiguang,Liu Guoying,Mei Tiancan,Qin Qianqing.A Segmentation Algorithm for High-Resolution Remote Sensing Texture Based on Spectral and Texture Information Weighting[J].ACTA OP TICA SINICA,2009,29(11):3010-3017.(in Chinese)
[18] 崔志华.微粒群算法的性能分析与优化[D].西安交通大学,西安,2008. Cui Zhihua.Performance Analysis and Optimization for Particel Swarn Optimization[D].Xi'an Jiaotong University,Xi'an,2008.(in Chinese)
[19] M.M.Dundar,D.Landgrebe.Toward An Optimal Analysis of Hyperspectral Data.PhD Thesis and School of Electrical & Computer Engineering Technical Report TR-ECE 03-07 May 2003.