Research on Kidnapping Detection and Re-Localization Based on Semantic Dimensional Chain of Corner Family

JIANG Lin; LI Yun-fei; LEI Bin; TANG Bo; LIU Qi; GUO Yu-fei

doi:10.12263/DZXB.20230358

您当前的位置：

首页 >

文章列表页 >

Research on Kidnapping Detection and Re-Localization Based on Semantic Dimensional Chain of Corner Family

PAPERS | 更新时间：2025-12-24

- Research on Kidnapping Detection and Re-Localization Based on Semantic Dimensional Chain of Corner Family
- ACTA ELECTRONICA SINICA Vol. 52, Issue 7, Pages: 2356-2368(2024)
- 作者机构：
  
  1.武汉科技大学冶金装备及控制教育部重点实验室，湖北武汉 430081
  2.武汉科技大学机器人与智能系统研究院，湖北武汉 430081
  3.武汉科技大学机械传动与制造工程湖北省重点实验室，湖北武汉 430081
- 作者简介：
- 基金信息：
  
  National Natural Science Foundation of China(51874217)
- DOI：10.12263/DZXB.20230358
  CLC： TP242.6;
- Received：21 April 2023，
  
  Revised：2023-12-21，
  
  Published：25 July 2024
- 稿件说明：
移动端阅览
蒋林, 李云飞, 雷斌, 等. 基于墙角族语义尺寸链的绑架定位研究[J]. 电子学报, 2024, 52(07): 2356-2368.

JIANG Lin, LI Yun-fei, LEI Bin, et al. Research on Kidnapping Detection and Re-Localization Based on Semantic Dimensional Chain of Corner Family[J]. Acta Electronica Sinica, 2024, 52(07): 2356-2368.
蒋林, 李云飞, 雷斌, 等. 基于墙角族语义尺寸链的绑架定位研究[J]. 电子学报, 2024, 52(07): 2356-2368. DOI：10.12263/DZXB.20230358

JIANG Lin, LI Yun-fei, LEI Bin, et al. Research on Kidnapping Detection and Re-Localization Based on Semantic Dimensional Chain of Corner Family[J]. Acta Electronica Sinica, 2024, 52(07): 2356-2368. DOI：10.12263/DZXB.20230358

摘要

针对目前原始自适应蒙特卡洛定位（Adaptive Monte Carlo Localization，AMCL）在相似环境下绑架检测容易出错且重定位极易失败等问题，提出基于墙角族语义尺寸链的改进AMCL算法.融合机器人多传感器信息和Gmapping算法构建二维栅格地图，基于Yolov5获取室内环境的目标检测框和类别信息，结合GrabCut算法和贝叶斯方法构建增量式语义映射地图；通过墙角的凸、凹和墙角相对于机器人的方位角对墙角进行分类，充分发掘语义映射地图中各墙角之间、墙角与室内物体之间的类别和位置关系，构建墙角族语义尺寸链和相应检索表；在定位过程中，基于墙角族语义尺寸链进行全局预定位，提出绑架检测机制进行绑架检测，在检测到绑架事件发生后，基于改进AMCL算法实现定位自恢复.最后，通过真实环境下的绑架实验验证了本文方法的有效性，实验表明，所提方法的全局定位准确率、全局定位速率、绑架检测准确率和绑架后定位准确率在相似环境下分别提升了42%、214%、88%和72%；在非相似环境下分别提升了44%、152%、12%和92%；在长走廊环境下分别提升了36%、426%、26%和68%.

Abstract

In order to solve the problems of kidnapping detection and re-localization failure of original AMCL(Adaptive Monte Carlo Localization) in similar environment

an improved AMCL algorithm based on semantic dimension chain of corner family is proposed. Firstly

the multi-sensor information of robot is fused and a two-dimensional grid map is constructed based on Gmapping algorithm. Secondly

the target detection frame and category information of indoor environment are obtained based on Yolov5

and the semantic mapping map is constructed incrementally by combining GrabCut algorithm and Bayesian method. The corners are classified based on their convexity

concavity

and the azimuth of the corners relative to the robot

and the category and position relationships between the corners and the indoor objects in the semantic mapping map are fully excavated. The semantic dimension chain of the corner family and the corresponding retrieval table are constructed. In the process of localization

global pre-localization is realized based on the semantic dimension chain of corner family

and kidnapping detection is carried out based on the proposed kidnapping detection mechanism

and localization self-recovery is realized based on the improved AMCL algorithm after the kidnapping event is detected. Finally

the effectiveness of this method is verified by kidnapping experiments in real environment. Experiments show that the proposed method improves the global localization accuracy

global localization rate

kidnapping detection accuracy and localization self-recovery success rate by 42%

214%

88% and 72%

respectively

in the similar environment; and 44%

152%

12% and 92%

respectively

in the non-similar environment; and 36%

426%

26% and 68%

respectively

in the long corridor environment.

关键词

Keywords

references

ZHANG L , ZAPATA R , Lépinay P . Self-adaptive Monte Carlo localization for mobile robots using range finders [C ] // IEEE/RSJ International Conference on Intelligent Robots and Systems . Piscataway : IEEE , 2012 : 229 - 244 .

CHOI J , MAURER M . Simultaneous localization and mapping based on the local volumetric hybrid map [C ] // 2015 IEEE Intelligent Vehicles Symposium . Piscataway : IEEE , 2015 : 561 - 566 .

蒋林 , 刘奇 , 雷斌 , 等 . 激光与视觉融合识别并构建语义地图改善定位性能 [J ] . 中国激光 , 2022 , 49 ( 18 ): 1810003 .

JIANG L , LIU Q , LEI B , et al . Identifying and constructing semantic maps based on laser and vision fusions for improving localization performance [J ] . Chinese Journal of Lasers , 2022 , 49 ( 18 ): 1810003 . (in Chinese)

蒋林 , 向超 , 朱建阳 , 等 . 加载语义似然估计的粒子滤波重定位 [J ] . 电子学报 , 2021 , 49 ( 2 ): 306 - 314 .

JIANG L , XIANG C , ZHU J Y , et al . Particle filter relocation with semantic likelihood estimation [J ] . Acta Electronica Sinica , 2021 , 49 ( 2 ): 306 - 314 . (in Chinese)

杨小龙 , 李欣 , 周牧 , 等 . 基于多维模糊映射AP优化的WLAN室内定位方法 [J ] . 电子学报 , 2022 , 50 ( 8 ): 1875 - 1884 .

YANG X L , LI X , ZHOU M , et al . WLAN indoor positioning method based on multi-dimensional fuzzy mapping AP optimization [J ] . Acta Electronica Sinica , 2022 , 50 ( 8 ): 1875 - 1884 (in Chinese)

YU S K , YAN F , ZHUANG Y , et al . A deep-learning-based strategy for kidnapped robot problem in similar indoor environment [J ] . Journal of Intelligent & Robotic Systems , 2020 , 100 ( 3 ): 765 - 775 .

ZHAO X , ZUO T , HU X Y . OFM-SLAM: A visual semantic SLAM for dynamic indoor environments [J ] . Mathematical Problems in Engineering , 2021 , 2021 : 5538840 .

房立金 , 刘博 , 万应才 . 基于深度学习的动态场景语义SLAM [J ] . 华中科技大学学报(自然科学版) , 2020 , 48 ( 1 ): 121 - 126 .

FANG L J , LIU B , WAN Y C . Semantic SLAM based on deep learning in dynamic scenes [J ] . Journal of Huazhong University of Science and Technology (Natural Science Edition) , 2020 , 48 ( 1 ): 121 - 126 . (in Chinese)

申文杰 , 任永杰 , 朱博源 , 等 . 结合人工信标和视觉SLAM的自主快速定位方法 [J ] . 机械工程学报 , 2022 , 58 ( 14 ): 137 - 145 .

SHEN W J , REN Y J , ZHU B Y , et al . Autonomous fast localization method combining artificial beacons and visual SLAM [J ] . Chinese Journal of Mechanical Engineering , 2022 , 58 ( 14 ): 137 - 145 . (in Chinese)

XIAO L H , WANG J G , QIU X S , et al . Dynamic-SLAM: Semantic monocular visual localization and mapping based on deep learning in dynamic environment [J ] . Robotics and Autonomous Systems , 2019 , 117 : 1 - 16 .

杨爽 , 曾碧 , 何炜婷 . 融合语义激光与地标信息的SLAM技术研究 [J ] . 计算机工程与应用 , 2020 , 56 ( 18 ): 262 - 271 .

YANG S , ZENG B , HE W T . Research on SLAM technology combining semantic laser and landmark information [J ] . Computer Engineering and Applications , 2020 , 56 ( 18 ): 262 - 271 . (in Chinese)

CHOI J , CHOI M , CHUNG K C . Topological localization with kidnap recovery using sonar grid map matching in a home environment [J ] . Robotics and Computer-Integrated Manufacturing , 2012 , 28 ( 3 ): 366 - 374 .

JEON Y P , PARK J H , LIM S T , et al . Research for robot kidnap problem in the indoor of utilizing external image information and the absolute spatial coordinates [J ] . Journal of the Korea Academia-Industrial Cooperation Society , 2015 , 16 ( 3 ): 2123 - 2130 .

BUKHORI I , ISMAIL Z H . Detection strategy for kidnapped robot problem in Monte Carlo localization based on similarity measure of environment [C ] // 2016 IEEE International Conference on Underwater System Technology: Theory and Applications (USYS) . Piscataway : IEEE , 2017 : 55 - 60 .

WANG Y , ZHANG W M , LI F , et al . UAPF: A UWB aided particle filter localization for scenarios with few features [J ] . Sensors , 2020 , 20 ( 23 ): 6814 .

钱琳 . 基于视觉的移动机器人定位绑架检测与恢复方法 [D ] . 长沙 : 湖南大学 , 2020 .

QIAN L . Vision-based Detection and Recovery Method of Mobile Robot Localization Kidnapping [D ] . Changsha : Hunan University , 2020 . (in Chinese)

NEULAND R , MANTELLI M , HUMMES B , et al . Robust hybrid interval-probabilistic approach for the kidnapped robot problem [J ] . International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems , 2021 , 29 ( 2 ): 313 - 331 .

杨傲雷 , 金宏宙 , 陈灵 , 等 . 融合深度学习与粒子滤波的移动机器人重定位方法 [J ] . 仪器仪表学报 , 2021 , 42 ( 7 ): 226 - 233 .

YANG A L , JIN H Z , CHEN L , et al . Mobile robot relocalization method fusing deep learning and particle filtering [J ] . Chinese Journal of Scientific Instrument , 2021 , 42 ( 7 ): 226 - 233 . (in Chinese)

SUN F , XU H , MENG Y H , et al . BERT and pareto dominance applied to bio-logical strategy decision for bio-inspired design [J ] . Advanced Engineering Informatics , 2023 , 55 : 101904 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Blind Integrated Sensing Algorithm for Near Field Communication Using Bayesian Method

Optical Tomography Reconstruction Based on Coupled Gradient Neural Network

Reliability Assessment of Products with Wiener Process Degradation by Fusing Multiple Information

Related Author

LI Yun-fei

TANG Bo

GUO Yu-fei

WANG Zhong-yong

SUN Peng

LIU Fei

CUI Jian-hua

YUAN Zheng-dao

Related Institution

School of Electrical and Information Engineering, Zhengzhou University

School of Applied Physics and Electronic Information, Luoyang Normal University

School of Information Engineering and Artificial Intelligence, Henan Open University

School of Electrical and Information Engineering

School of Applied Physics and Electronic Information

⁰