基于前景优化的视觉目标跟踪算法

谢青松; 刘晓庆; 安志勇; 李博

doi:10.12263/DZXB.20210641

您当前的位置：

首页 >

文章列表页 >

基于前景优化的视觉目标跟踪算法

学术论文 | 更新时间：2025-12-08

- 基于前景优化的视觉目标跟踪算法
- Visual Object Tracking Algorithm Based on Foreground Optimization
- 电子学报 2022年50卷第7期页码：1558-1566
- 作者机构：
  
  1.山东工商学院计算机科学与技术学院，山东烟台 264000
  2.山东工商学院信息与电子工程学院，山东烟台 264000
- 作者简介：
  
  [ "谢青松男，1965年1月生于山东青岛，现为山东工商学院计算机科学与技术学院教授、硕士生导师，主要研究方向为智能算法、图像识别、目标跟踪.E-mail: qs_xie@163.com" ]
  [ "刘晓庆女，1996年5月生于山东青岛，现为山东工商学院信息与电子工程学院硕士研究生，主要研究方向为目标跟踪.E-mail: 1322699199@qq.com" ]
  [ "安志勇（通讯作者）男，1975年10月生于山西怀仁，工学博士，现为山东工商学院计算机科学与技术学院副教授，研究方向为计算机视觉、目标跟踪等.E-mail:azytyut@163.com" ]
  [ "李博男，1980年3月生于辽宁锦州，东北大学信息科学与工程学院计算机系统结构博士，研究领域为大数据与机器学习." ]
- 基金信息：
  
  国家自然科学基金(62072285);山东省自然科学基金(ZR202102230438;ZR202102180144;ZR202103070119;ZR2020MA030);山东省重点研发计划（软科学）(2020RKB01017);山东工商学院校级教学改革项目(11688202023)
- DOI：10.12263/DZXB.20210641
  中图分类号： TP391.4
- 收稿：2021-05-19，
  
  修回：2021-10-07，
  
  纸质出版：2022-07-25
- 稿件说明：
移动端阅览
谢青松,刘晓庆,安志勇等.基于前景优化的视觉目标跟踪算法[J].电子学报,2022,50(07):1558-1566.

XIE Qing-song,LIU Xiao-qing,AN Zhi-yong,et al.Visual Object Tracking Algorithm Based on Foreground Optimization[J].ACTA ELECTRONICA SINICA,2022,50(07):1558-1566.
谢青松,刘晓庆,安志勇等.基于前景优化的视觉目标跟踪算法[J].电子学报,2022,50(07):1558-1566. DOI： 10.12263/DZXB.20210641.

XIE Qing-song,LIU Xiao-qing,AN Zhi-yong,et al.Visual Object Tracking Algorithm Based on Foreground Optimization[J].ACTA ELECTRONICA SINICA,2022,50(07):1558-1566. DOI： 10.12263/DZXB.20210641.

摘要

将目标分割技术引入跟踪领域是当前的研究热点.目前，基于分割的跟踪算法往往根据分割结果计算最小外接矩形，以此作为跟踪框，但复杂的目标运动使得跟踪框内包含较多背景，从而导致精度下降.针对该问题，本文提出了一种基于前景优化的视觉目标跟踪算法，将跟踪框的尺度和角度优化统一于前景优化框架中.首先评估跟踪框内的前景比例，若小于设定阈值，则对跟踪框分别进行尺度和角度优化；在尺度优化模块中，结合回归框计算跟踪框的条件概率，根据条件概率的结果分情形进行尺度优化；角度优化模块中，针对跟踪框设定多个偏移角度，利用前景IoU（Intersection over Union）极大策略选择最优跟踪框角度.结果证明，将本文方法应用于SiamMask算法，精度在VOT2016，VOT2018和VOT2019数据集分别提升约3.2%，3.7%和3.6%，而EAO分别提升约1.8%，1.9%和1.6%.另外，本文的方法针对基于分割的跟踪算法具有一定的普适性.

Abstract

The introduction of object segmentation technology into the tracking field is a current research hotspot. At present

the tracking algorithm based on segmentation often calculates the minimum bounding rectangle as the bounding box according to the segmentation result. However

the complex target movement makes the bounding box contain more background

which leads to a decrease in accuracy. In response to the problem

this paper proposes a visual object tracking algorithm based on foreground optimization

which unifies the optimization of the scale and angle in the bounding box into the foreground optimization frame. First

the foreground ratio in the bounding box is evaluated. If it is less than the set threshold

the scale and angle of the bounding box are optimized; in the scale optimization module

the conditional probability of the bounding box is calculated in combination with the regression box

and the scale is optimized according to the results of the conditional probability; in the angle optimization module

many deviation angles are set for the bounding box

and the optimal bounding box angle is chosen by the foreground IoU (Intersection over Union) maximum strategy. The proposed method is applied to the SiamMask algorithm. Results show that the accuracy is improved by about 3.2%

3.7% and 3.6% in the VOT2016

VOT2018 and VOT2019 data sets

respectively

while EAO is increased by about 1.8%

1.9% and 1.6%

respectively. Moreover

our method has a certain universality for segmentation-based tracking algorithms.

关键词

Keywords

references

MATHUR G , SOMWANSHI D , BUNDELE M . Intelligent video surveillance based on object tracking [C]// Proceedings of the 2018 3rd International Conference and Workshops on Recent Advances and Innovations in Engineering . Jaipur, India : IEEE Press , 2018 : 1 - 6 .

GAJJAR V , KHANDHEDIYA Y , GURNANI A . Human detection and tracking for video surveillance: A cognitive science approach [C]// Proceedings of the IEEE International Conference on Computer Vision Workshops . Venice, Italy : IEEE Press , 2017 : 2805 - 2809 .

CHEN B , SAHDEV R , TSOTSOS J , et al . Person following robot using selected online ada-boosting with stereo camera [C]// Proceedings of the 2017 14th Conference on Computer and Robot Vision . Edmonton, Canada : IEEE Press , 2017 : 48 - 55 .

张爱梅 . 目标跟踪瞄准系统的虚拟现实研究 [D]. 西安 : 西安电子科技大学 , 2004 .

ZHANG Ai-mei . Virtual Reality Research of Target Tracking and Aiming System [D]. Xi'an : Xidian University , 2004 . (in Chinese)

AGARWAL N , CHIANG C , SHARMA A . A study on computer vision techniques for self-driving cars [C]// Proceedings of the International Conference on Frontier Computing . Singapore : Springer , 2019 : 629 - 634 .

孟琭 , 杨旭 . 目标跟踪算法综述 [J]. 自动化学报 , 2019 , 45 ( 7 ): 1244 - 1260 .

MENG Lu , YANG Xu . A survey of object tracking algorithms [J]. Acta Automatica Sinica , 2019 , 45 ( 7 ): 1244 - 1260 . (in Chinese)

WU Y , LIM J , YANG M H . Online object tracking: A benchmark [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Portland, USA : IEEE Press , 2013 : 2411 - 2418 .

李玺 , 查宇飞 , 张天柱 , 等 . 深度学习的目标跟踪算法综述 [J]. 中国图象图形学报 , 2019 , 24 ( 12 ): 2057 - 2080 .

LI Xi , ZHA Yu-fei , ZHANG Tian-zhu , et al . Survey of visual object tracking algorithms based on deep learning [J]. Journal of Image and Graphics , 2019 , 24 ( 12 ): 2057 - 2080 . (in Chinese)

SUN D Q , ROTH S , BLACK M J . Secrets of optical flow estimation and their principles [C]// Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition . San Francisco, CA : IEEE , 2010 : 2432 - 2439 .

XU L , JIA J Y , MATSUSHITA Y . Motion detail preserving optical flow estimation [C]// Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition . San Francisco, USA : IEEE , 2010 : 1293 - 1300 .

NUMMIARO K , KOLLER-MEIER E , VAN GOOL L . An adaptive color-based particle filter [J]. Image and Vision Computing , 2003 , 21 ( 1 ): 99 - 110 .

DU K , JU Y F , JIN Y L , et al . Object tracking based on improved MeanShift and SIFT [C]// Proceedings of the 2nd International Conference on Consumer Electronics, Communications and Networks . Yichang, China : IEEE , 2012 : 2716 - 2719 .

EXNER D , BRUNS E , KURZ D , et al . Fast and robust CAMShift tracking [C]// Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition . San Francisco, USA : IEEE , 2010 : 9 - 16 .

BOLME D , BEVERIDGE J , DRAPER B , LUI Y . Visual object tracking using adaptive correlation filters [C]// Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition . San Francisco, USA : IEEE , 2010 : 2544 - 2550 .

DANELLJAN M , et al . Discriminative scale space tracking [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2017 , 39 ( 8 ): 1561 - 1575 .

丁新尧 , 张鑫 . 基于显著性特征的选择性目标跟踪算法 [J]. 电子学报 , 2020 , 48 ( 1 ): 118 - 123 .

DING Xin-yao , ZHANG Xin . Visual tracking with salient features and selective mechanism [J]. Acta Electronica Sinica , 2020 , 48 ( 1 ): 118 - 123 . (in Chinese)

王治丹 , 蒋建国 , 齐美彬 , 等 . 基于最大池图匹配的形变目标跟踪方法 [J]. 电子学报 , 2017 , 45 ( 3 ): 704 - 711 .

WANG Zhi-dan , JIANG Jian-guo , QI Mei-bin , et al . Deformable object tracking based on max-pooling graph matching [J]. Acta Electronica Sinica , 2017 , 45 ( 3 ): 704 - 711 . (in Chinese)

WANG N Y , YEUNG D Y . Learning a deep compact image representation for visual tracking [C]// Proceedings of the 26th International Conference on Neural Information Processing Systems . Lake Tahoe, Nevada : Curran Associates Inc , 2013 : 809 - 817 .

ROUT L , MISHRA D , et al . Rotation adaptive visual object tracking with motion consistency [C]// Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision(WACV) . Lake Tahoe, USA : IEEE , 2018 : 1047 - 1055 .

HUA Y , ALAHARI K , SCHMID C . Online object tracking with proposal selection [C]// Proceedings of the IEEE International Conference on Computer Vision . Santiago, Chile : IEEE , 2015 : 3092 - 3100 .

WANG Q , ZHANG L , BERTINETTO L , et al . Fast online object tracking and segmentation: A unifying approach [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Long Beach, USA : IEEE Press , 2019 : 1328 - 1338 .

PINHEIRO P O , COLLOBERT R , DOLLAR P . Learning to segment object candidates [C]// Proceedings of the Neural Information Processing Systems . Montreal, Canada : ACM , 2015 : 1990 - 1998 .

PINHEIRO P O , LIN T , COLLOBERT R , et al . Learning to refine object segments [C]// Proceedings of the European Conference on Computer Vision . Amsterdam : Springer , 2016 : 75 - 91 .

KRISTAN M , LEONARDIS A , MATAS J , et al . The visual object tracking vot2016 challenge results [C]// Proceedings of the European Conference on Computer Vision . Amsterdam : Springer , 2016 : 777 - 823 .

KRISTAN M , LEONARDIS A , MATAS J , et al . The sixth visual object tracking vot2018 challenge results [C]// Proceedings of the European Conference on Computer Vision . Munich, Germany : Springer , 2018 : 3 - 53 .

KRISTAN M , LEONARDIS A , MATAS J , et al . The seventh visual object tracking vot2019 challenge results [C]// Proceedings of the IEEE International Conference on Computer Vision Workshop . Seoul, Korea : IEEE , 2019 : 2206 - 2241 .

BERTINETTO L , VALMADRE J , HENRIQUES J F , et al . Fully-convolutional Siamese networks for object tracking [C]// Proceedings of the European Conference on Computer Vision . Amsterdam : Springer , 2016 : 850 - 865 .

LI B , YAN J , WU W , et al . High performance visual tracking with Siamese region proposal network [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Salt Lake, USA : IEEE Press , 2018 : 8971 - 8980 .

LI B , WU W , WANG Q , et al . SiamRPN++: Evolution of Siamese visual tracking with very deep networks [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Long Beach, USA : IEEE Press , 2018 : 4277 - 4286 .

GUO D , WANG J , CUI Y , et al . SiamCAR: Siamese fully convolutional classification and regression for visual tracking [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Seattle, USA : IEEE , 2020 : 6268 - 6276 .

CHEN Z , ZHONG B , LI G , et al . Siamese box adaptive network for visual tracking [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Seattle, USA : IEEE , 2020 : 6667 - 6676 .

HE A , LUO C , TIAN X , et al . A twofold Siamese network for real-time object tracking [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Salt Lake City, USA : IEEE , 2018 : 4834 - 4843 .

DU Y , LIU P , ZHAO W , et al . Correlation-guided attention for corner detection based visual tracking [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Seattle, USA : IEEE , 2020 : 6835 - 6844 .

REN S , HE K , GIRSHICK R , et al . Faster R-CNN: Towards real-time object detection with region proposal networks [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2017 , 39 ( 6 ): 1137 - 1149 .

CHEN B , TSOTSOS JOHN K . Fast visual object tracking using ellipse fitting for rotated bounding boxes [C]// 2019 IEEE/CVF International Conference on Computer Vision Workshop(ICCVW) . Seoul : IEEE , 2019 : 2281 - 2289 .

ZHU Z , WANG Q , LI B , et al . Distractor-aware Siamese networks for visual object tracking [C]// Proceedings of the IEEE European Conference on Computer Vision . Munich, Germany : Springer , 2018 : 103 - 119 .

WANG G , LUO C , XIONG Z , et al . SPM-tracker: Series-parallel matching for real-time visual object tracking [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Long Beach, USA : IEEE , 2019 : 3638 - 3647 .

VOIGTLAENDER P , LUITENET J , et al . Siam R-CNN: Visual tracking by re-detection [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Seattle, USA : IEEE , 2020 : 6577 - 6587 .

ZHANG Z , PENG H . Deeper and wider Siamese networks for real-time visual tracking [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Long Beach, USA : IEEE , 2019 : 4586 - 4595 .

LI X , MA C , WU B , et al . Target-aware deep tracking [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Long Beach, USA : IEEE , 2019 : 1369 - 1378 .

DAI K , WANG D , LU H , et al . Visual tracking via adaptive spatially- regularized correlation filters [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Long Beach, USA : IEEE , 2019 : 4665 - 4674 .

PARK E , BERG A C . Meta-tracker: Fast and robust online adaptation for visual object trackers [C]// Proceedings of the IEEE European Conference on Computer Vision . Munich, Germany : Springer, Cham , 2018 : 587 - 604 .

ZHANG L , GONZALEZ-GARCIA A , WEIJER J , et al . Learning the model update for Siamese trackers [C]// Proceedings of the IEEE International Conference on Computer Vision . Seoul, Korea : IEEE , 2019 : 4010 - 4019 .

YANG T , XU P , HU R , et al . ROAM: Recurrently optimizing tracking model [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Seattle, USA : IEEE , 2020 : 6717 - 6726 .

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于特征自适应选取的视觉目标跟踪算法

3D稀疏卷积结构下融合空间点与体素关系建模的LiDAR点云跟踪方法

基于纵横比自适应的相关滤波跟踪算法

基于双模型竞争机制的目标跟踪算法