结合分类与迁移学习的薄云覆盖遥感图像地物信息恢复

doi:10.3969/j.issn.0372-2112.2017.12.005

电子学报 ›› 2017, Vol. 45 ›› Issue (12): 2855-2862.DOI: 10.3969/j.issn.0372-2112.2017.12.005

结合分类与迁移学习的薄云覆盖遥感图像地物信息恢复

胡根生^1,2,3, 查慧敏^1,2, 梁栋^1,2, 鲍文霞^1,2,3

1. 安徽大学计算智能与信号处理教育部重点实验室, 安徽合肥 230039;
2. 安徽大学电子信息工程学院, 安徽合肥 230601;
3. 偏振光成像探测技术安徽省重点实验室, 安徽合肥 230031

收稿日期:2016-06-04 修回日期:2017-01-10 出版日期:2017-12-25
- 通讯作者:
- 梁栋
- 作者简介:
- 胡根生,男,1971年生于安徽无为,博士,教授,主要研究方向为机器学习、图像处理、模式识别等.E-mail:hugs2906@sina.com;查慧敏,女,1991年生于安徽池州,硕士研究生,主要研究方向为机器学习、图像处理等.E-mail:18110931853@163.com;鲍文霞,女,1980年生于安徽铜陵,博士,副教授,主要研究方向为计算机视觉、图像处理、模式识别等.E-mail:bwxia@ahu.edu.cn
- 基金资助:
- 国家自然科学基金 (No.61672032，No.61401001）; 安徽省自然科学基金 (No.1408085MF121）; 偏振光成像探测技术安徽省重点实验室开放课题 (No.2016-KFKT-003）

Ground Object Information Recovery for Thin Cloud Contaminated Remote Sensing Images by Combining Classification with Transfer Learning

HU Gen-sheng^1,2,3, ZHA Hui-min^1,2, LIANG Dong^1,2, BAO Wen-xia^1,2,3

1. Key Laboratory of Intelligent Computing and Signal Processing, Ministry of Education, Anhui University, Hefei, Anhui 230039, China;
2. School of Electronics and Information Engineering, Anhui University, Hefei, Anhui 230601, China;
3. Anhui Key Laboratory of Polarization Imaging Detection Technology, Hefei, Anhui 230031, China

Received:2016-06-04 Revised:2017-01-10 Online:2017-12-25 Published:2017-12-25
- Supported by:
- National Natural Science Foundation of China (No.61672032, No.61401001); Natural Science Foundation of Anhui Province (No.1408085MF121); Open Project of Anhui Provincial Key Laboratory of Polarized Light Imaging Detection Technology, Hefei 230031, China (No.2016-KFKT-003)

摘要/Abstract

摘要： 利用多源多时相遥感图像，给出一种结合分类与迁移学习的薄云覆盖遥感图像地物信息恢复算法.首先利用多方向非抽样对偶树复小波变换对多源多时相遥感图像进行多分辨率分解，对分解后的薄云图像的高频系数利用贝叶斯方法进行地物初分类；再对每类地物的低频系数通过迁移最小方差支持向量回归模型进行域自适应学习，获取模型参数；最后利用所获的迁移回归模型，用无云参考图像的低频系数预测薄云覆盖图像的低频系数，去除薄云，恢复薄云覆盖图像的地物信息.实验结果表明，本文算法恢复的地物细节清楚，光谱失真较小.特别对地物季节性变化的薄云覆盖遥感图像，本文算法能有效恢复薄云覆盖区域的地物信息.

关键词: 遥感图像, 信息恢复, 图像分类, 迁移学习

Abstract: By using multi-source and multi-temporal remote sensing images,a ground object information recovery algorithm for thin cloud contaminated remote sensing images is proposed by combining classification with transfer learning.Firstly,multi-resolution decomposition of multi-source and multi-temporal remote sensing images is performed by using multi-directional nonsubsampled dual-tree complex wavelet transform.The decomposed high frequency coefficients of the ground objects of the thin cloud images are primarily classified by using Bayesian method.Then the transfer least square support vector regression model is trained to obtain the model parameters by using the domain adaptive learning of the low frequency coefficients of each class of ground objects.Finally,the low frequency coefficients of the thin cloud-contaminated images are predicted by using those of the cloudless reference images.The thin clouds are removed and the ground object information of the thin cloud contaminated images is recovered.Experimental results show that the ground objects recovered by the proposed algorithm have clear spatial details and small spectral distortion.Especially for the thin cloud contaminated remote sensing images with seasonal variation of ground objects,the proposed algorithm can effectively recover the ground object information contaminated by thin clouds.

Key words: remote sensing image, information recovery, image classification, transfer learning

中图分类号:

TP391

胡根生, 查慧敏, 梁栋, 等. 结合分类与迁移学习的薄云覆盖遥感图像地物信息恢复[J]. 电子学报, 2017, 45(12): 2855-2862.

HU Gen-sheng, ZHA Hui-min, LIANG Dong, et al. Ground Object Information Recovery for Thin Cloud Contaminated Remote Sensing Images by Combining Classification with Transfer Learning[J]. Acta Electronica Sinica, 2017, 45(12): 2855-2862.

参考文献

[1] Rasti B,Sveinsson J R,Ulfarsson M O.Wavelet-based sparse reduced-rank regression for hyperspectral image restoration[J].IEEE Transactions on Geoscience and Remote Sensing,2014,52(10):6688-6698.
[2] Wang X,Li M M,Tang H M.A modified homomorphism filtering algorithm for cloud removal[A].2010 International Conference on Computational Intelligence and Software Engineering[C].Wuhan,China:IEEE,2010.1-4.
[3] Wu X P,Yang W N,Li G M.Thin cloud removal of ZY-3 image based on improved homomorphism filtering method[A].21st International Conference on Geoinformatics[C].Kaifeng,China:IEEE,2013.1-4.
[4] Leung Y,Liu J,Zhang J S.An improved adaptive intensity-hue-saturation method for the fusion of remote sensing images[J].IEEE Geoscience and Remote Sensing Letters,2014,11(5):985-989.
[5] Gao C,Zhu H J,Guo Y C.Analysis and improvement of SUSAN algorithm[J].Signal Processing,2012,92(10):2552-2559.
[6] 卢力,王勇涛,田金文,柳健.基于SUSAN算法的遥感图像去云[J].通信学报,2006,27(8):160-164. Lu Li,Wang Yongtao,Tian Jinwen,Liu Jian.Clould removal from satellite imagery based on SUSAN algorithm[J].Journal of Communication,2006,27(8):160-164.(in Chinese)
[7] Zhu X F,Wu F,Zhuang Y P.An improved approach to remove cloud and mist from remote sensing digital images based on Mallat algorithm[J].Journal of Remote Sensing,2007,11(2):241-246.
[8] Zhu X F,Jiang X L,Li.F Removing thin cloud in color remote sensing images[J].Journal of Applied Optics,2007,28(6):698-701.
[9] 李新宇,刘扬阳,蒋雪娜,王守觉.基于高维空间几何信息学的遥感图像去薄云算法[J].电子学报,2011,39(5):1002-1006. Li Xinyu,Liu Yangyang,Jiang Xuena,Wang Shoujue.An noval algorithm to remove the thin cloud from remote sensing images based on high-dimensional space geometrical informatics[J].Acta Electronica Sinica,2011,39(5):1002-1006.(in Chinese)
[10] Luo B,Khan M M,Bienvenu T.Decision-based fusion for pansharpening of remote sensing images[J].IEEE Geoscience and Remote Sensing Letters,2013,10(1):19-23.
[11] Chien C L,Tsai W H.Image fusion with no gamut problem by improved nonlinear IHS transforms for remote sensing[J].IEEE Transactions on Geoscience and Remote Sensing,2014,52(1):651-663.
[12] Shi C,Liu F, Li L L,Hao H X.Pan-sharpening algorithm to remove thin cloud via mask dodging and nonsampled shift-invariant shearlet transform[J].Journal of Applied Remote Sensing,2014,8(1):083658.
[13] Makarau A,Richter R,Schl? pfer D,Reinartz P.Combined haze and cirrus removal for multispectral imagery[J].IEEE Geoscience and Remote Sensing Letters,2016,13(3):379-383.
[14] Lorenzi L,Melgani F,Mercier G.Missing-area reconstruction in multispectral images under a compressive sensing perspective[J].IEEE Transactions on Geoscience and Remote Sensing,2013,51(7):3998-4008.
[15] Hu G S,Li X Y,Liang D.Thin cloud removal from remote sensing images using multidirectional dual tree complex wavelet transform and transfer least square support vector regression[J].Journal of Applied Remote Sensing,2015,9(1):095053,1-19.
[16] Pan S J,Yang Q.A survey on transfer learning[J].IEEE Transactions on Knowledge and Data Engineering,2010,22(10):1345-1359.
[17] Pan S J, Tsang I W,Kwok J T,Yang Q.Domain adaption via transfer component analysis[J].IEEE Transactions on Neural Networks,2011,22(2):199-210.
[18] L X Duan,I W Tsang,D Xu.Domain transfer multiple kernel learning[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2012,34(3):465-479.
[19] Duan L X,Xu D,Tsang I W.Domain adaptation from multiple sources:a domain-dependent regularization approach[J].IEEE Transactions on Neural Networks and Learning Systems,2012,23(3):504-518.
[20] 韩敏,杨雪.改进贝叶斯ARTMAP的迁移学习遥感影像分类算法[J].电子学报,2016,44(9):2248-2253. Han Min,Yang Xue.Transfer learning using improved bayesian ARTMAP for remote sensing image classification[J].Acta Electronica Sinica,2016,44(9):2248-2253.(in Chinese)
[21] Yang J,Yan R,Hauptmann A G.Cross-domain video concept detection using adaptive svms[A].Proceedings of the 15th ACM International Conference on Multimedia[C].Augsburg,Germany:ACM,2007,188-197.
[22] Scholkopt B,Smola A J.Learning with Kernels[M].Cambridge,MA:The M IT Press,2002.

结合分类与迁移学习的薄云覆盖遥感图像地物信息恢复

Ground Object Information Recovery for Thin Cloud Contaminated Remote Sensing Images by Combining Classification with Transfer Learning

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	吴军君, 王涛, 王英楷, 王星辉. 基于迁移学习的LiPON制备工艺模拟优化[J]. 电子学报, 2023, 51(3): 687-693.
[2]	杨威, 李玮杰, 刘永祥, 黎湘. 基于测地线流式核的雷达目标高分辨距离像鲁棒识别方法[J]. 电子学报, 2023, 51(3): 527-536.
[3]	许新征, 李杉. 基于特征膨胀卷积模块的轻量化技术研究[J]. 电子学报, 2023, 51(2): 355-364.
[4]	王子为, 鲁继文, 周杰. 基于自适应梯度优化的二值神经网络[J]. 电子学报, 2023, 51(2): 257-266.
[5]	邵志文, 周勇, 谭鑫, 马利庄, 刘兵, 姚睿. 基于深度学习的表情动作单元识别综述[J]. 电子学报, 2022, 50(8): 2003-2017.
[6]	徐建博, 魏昕, 周亮. 面向跨模态通信的信息恢复技术[J]. 电子学报, 2022, 50(7): 1631-1642.
[7]	杨曦, 张鑫, 郭浩远, 王楠楠, 高新波. 基于不变特征的多源遥感图像舰船目标检测算法[J]. 电子学报, 2022, 50(4): 887-899.
[8]	王雪松, 张翰林, 程玉虎. 基于自编码器和超图的半监督宽度学习系统[J]. 电子学报, 2022, 50(3): 533-539.
[9]	李维刚, 甘平, 谢璐, 李松涛. 基于样本对元学习的小样本图像分类方法[J]. 电子学报, 2022, 50(2): 295-304.
[10]	赵旭东, 陶然, 李伟, 张蒙蒙. 高光谱图像分数域信息提取理论与方法进展[J]. 电子学报, 2022, 50(12): 2874-2883.
[11]	陈文俊, 杨春玲. 图像压缩感知的特征域优化及自注意力增强神经网络重构算法[J]. 电子学报, 2022, 50(11): 2629-2637.
[12]	张小恒, 张馨月, 李勇明, 王品, 刘玉川. 面向帕金森病语音诊断的非监督两步式卷积稀疏迁移学习算法[J]. 电子学报, 2022, 50(1): 177-184.
[13]	李勇斌, 王彬, 邵高平, 邵帅. 一种基于RCGAN的水声通信信号降噪方法[J]. 电子学报, 2022, 50(1): 54-62.
[14]	周勇, 陈思霖, 赵佳琦, 张迪, 王瀚正. 基于弱语义注意力的遥感图像可解释目标检测[J]. 电子学报, 2021, 49(4): 679-689.
[15]	唐焕玲, 郑涵, 刘艳红, 马思源, 窦全胜, 鲁明羽. Tr-SLDA:一种面向交叉领域的迁移主题模型[J]. 电子学报, 2021, 49(3): 605-613.