电子学报 ›› 2022, Vol. 50 ›› Issue (4): 887-899.DOI: 10.12263/DZXB.20210842

• 机器学习交叉融合创新 • 上一篇    下一篇

基于不变特征的多源遥感图像舰船目标检测算法

杨曦1, 张鑫1, 郭浩远1, 王楠楠1, 高新波1,2   

  1. 1.西安电子科技大学综合业务网理论及关键技术国家重点实验室,陕西 西安 710071
    2.重庆邮电大学图像认知重庆市重点实验室,重庆 400065
  • 收稿日期:2021-07-05 修回日期:2021-09-26 出版日期:2022-04-25 发布日期:2022-04-25
  • 作者简介:杨 曦 女,1988年10月出生,陕西咸阳人.现为西安电子科技大学通信工程学院教授、博士生导师.研究方向为计算机视觉和机器学习.E-mail: yangx@xidian.edu.cn
    张 鑫 男,1998年11月出生,陕西渭南人.现为西安电子科技大学通信工程学院硕士研究生.研究方向为计算机视觉和目标检测.E-mail: xzhang_98@stu.xidian.edu.cn
    郭浩远 男,1996年2月出生,河南郑州人.2021年获得西安电子科技大学通信工程学院硕士学位.研究方向计算机视觉和机器学习.E-mail: guohy@stu.xidian.edu.cn
    王楠楠 男,1986年11月出生,山东安丘人.现为西安电子科技大学通信工程学院教授、博士生导师.研究方向为计算机视觉和机器学习.E-mail: nnwang@xidian.edu.cn
    高新波(通讯作者) 男,1972年8月出生,山东莱芜人.现为西安电子科技大学电子工程学院教授、博士生导师,重庆邮电大学计算机学院教授、博士生导师.研究方向为计算机视觉和机器学习.
  • 基金资助:
    国家自然科学基金(61976166);陕西省重点研发计划(2021GY-030);陕西省创新人才推进计划(2020KJXX-027);中央高校基本科研业务费(JB210115)

Invariant Features Based Ship Detection Model for Multi-source Remote Sensing Images

YANG Xi1, ZHANG Xin1, GUO Hao-yuan1, WANG Nan-nan1, GAO Xin-bo1,2   

  1. 1.State Key Laboratory of Integrated Services Networks,Xidian University,Xi’an,Shaanxi 710071,China
    2.Chongqing Key Laboratory of Image Cognition,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
  • Received:2021-07-05 Revised:2021-09-26 Online:2022-04-25 Published:2022-04-25

摘要:

由于域偏移的存在,多源图像舰船目标检测任务面临着不同源传感器带来的图像风格差异难题.另外,为特定数据源训练特定的检测模型会消耗大量的计算资源,严重限制了其在军民用领域的工程应用.因此,设计一个通用网络以有效检测来自不同源遥感数据的舰船目标成了当下的研究热点.针对该需求,本文提出了一种基于不变特征的通用舰船目标检测方法,通过充分利用多源数据之间的共享知识实现通用遥感目标的网络检测.本方法由2部分组成:图像级的风格转换网络和特征级的域自适应网络.具体地,前者采用风格转换网络生成接近真实分布的伪多源图像,拉近多源数据之间的分布,在图像层面上学习多源数据的不变特征;为学习特征层面上多源数据的不变特征,后者通过适应网络对多源特征进行信息解耦,通过域注意力网络的自适应权重分配实现特征重组.本文在NWPU VHR-10,SSDD,HRSC和SAR-Ship-Dataset数据集上进行实验验证,结果表明:所提方法通过不变特征之间的信息互补,缓解了域偏移问题,可有效检测多源遥感数据.本文方法在上述多源数据集上的平均mAP为90.8%,相比现有主流舰船目标检测方法可以提高1.4%~10.6%.

关键词: 舰船检测, 遥感图像, 深度学习, 风格转换, 域自适应

Abstract:

Due to the domain shift, ship detection in multi-source data suffers from image variations caused by different source sensors. In addition, training a specific model for a particular data source consumes high computational cost, which severely limits its practical application in military and civilian fields. Therefore, designing a universal network to effectively detect ship objects from multi-source remote sensing images has become a research hotspot. To this end, the paper proposes a universal ship detection algorithm based on invariant features, which realizes a universal remote sensing object detection network by fully utilizing the shared knowledge among multi-source data. Our method mainly consists of two parts, i.e., an image-level style transfer network and a feature-level domain adaptive network. Specifically, the former employs style transfer network to generate pseudo-multi-source images that are close to the real distribution, narrow the distribution between multi-source data, and extract the invariant features of multi-source data at the image level; To extract invariant features at the feature level, the latter decouples the multi-source features through adaptive network, and realizes feature reorganization through adaptive weight allocation of domain attention network. We evaluate the proposed method using multiple datasets including NWPU VHR-10, SSDD, HRSC and SAR-Ship-Dataset. Experimental results show that the proposed method alleviates the problem of domain shift by complementing the information between invariant features, and can effectively detect multi-source remote sensing data. The average mAP of our method on the above-mentioned multi-source datasets is 90.8%, which exceeds 1.4%-10.6% compared with the existing mainstream ship object detection methods.

Key words: ship detection, remote sensing images, deep learning, style transfer, domain adaptation

中图分类号: