基于双目视觉的改进特征立体匹配方法

王笛; 胡辽林

doi:10.12263/DZXB.20200919

您当前的位置：

首页 >

文章列表页 >

基于双目视觉的改进特征立体匹配方法

学术论文 | 更新时间：2025-12-08

- 基于双目视觉的改进特征立体匹配方法
- Improved Feature Stereo Matching Method Based on Binocular Vision
- 电子学报 2022年50卷第1期页码：157-166
- 作者机构：
  
  西安理工大学机械与精密仪器工程学院, 陕西西安 710048
- 作者简介：
  
  [ "王笛男，1994年4月出生于陕西省西安市. 现为西安理工大学机械与精密仪器工程学院研究生.主要研究方向为机器视觉、立体视觉与图像处理算法.E-mail:576035322@qq.com" ]
  [ "胡辽林（通信作者）男，1968年5月出生于四川省岳池县.现为西安理工大学机械与精密仪器工程学院副教授、硕士生导师. 参与国家自然科学、陕西省自然科学基金项目.E-mail:huliaolin@163.com" ]
- 基金信息：
  
  陕西省自然科学基金(2014JM7273)
- DOI：10.12263/DZXB.20200919
  中图分类号： TP391;
- 收稿：2020-08-21，
  
  修回：2021-01-04，
  
  纸质出版：2022-01-25
- 稿件说明：
移动端阅览
王笛,胡辽林.基于双目视觉的改进特征立体匹配方法[J].电子学报,2022,50(01):157-166.

WANG Di,HU Liao-lin.Improved Feature Stereo Matching Method Based on Binocular Vision[J].ACTA ELECTRONICA SINICA,2022,50(01):157-166.
王笛,胡辽林.基于双目视觉的改进特征立体匹配方法[J].电子学报,2022,50(01):157-166. DOI： 10.12263/DZXB.20200919.

WANG Di,HU Liao-lin.Improved Feature Stereo Matching Method Based on Binocular Vision[J].ACTA ELECTRONICA SINICA,2022,50(01):157-166. DOI： 10.12263/DZXB.20200919.

摘要

针对特征立体匹配方法只能得到稀疏视差以及弱纹理匹配率低以及视差精度不足导致视差连续处不平滑而呈阶梯状等问题，提出一种改进的特征立体匹配算法. 对预处理后的左右图像提取特征并进行特征匹配，再经过筛选获取准确的匹配点对；将得到的稀疏匹配点对作为种子点，依据视差连续性与极线约束准则建立一维搜索空间，利用积分图简化的快速零均值归一化互相关系数作为相似度量函数，通过双向匹配策略实现区域生长，大大提升匹配准确性的同时降低算法复杂度；通过亚像素拟合和加权中值滤波后处理提升视差精度，去除视差阶梯分层、噪声和条纹现象. Middlebury数据集实验结果表明，本算法得到了准确性更高且稠密的视差，提高了弱纹理区与深度不连续处的匹配效果以及整体视差精度，同时具有很强的鲁棒性，能抑制一定亮度差异和噪声的影响.

Abstract

The feature-based stereo matching method can only get sparse disparity

and the low matching rate of weak texture areas and insufficient disparity accuracy lead to problems such as unsmooth continuity and stepped disparity. An improved features stereo matching algorithm is proposed. Extract features from the left and right images after preprocessing and perform feature matching

and then filter to obtain accurate matching point pairs; The obtained sparse matching point pairs are used as seed points

the search space is established according to the disparity continuity and the extreme line constraint criterion

and the fast zero-mean normalized cross-correlation simplified by integral graph is used as the similarity measurement function to achieve region growth through a two-way matching strategy

which greatly improves matching accuracy and reduces matching complexity; Sub-pixel fitting and weighted median filtering are used to improve the accuracy of disparity

remove disparity step layering

noise and streaks. The experimental results of the Middlebury data set show that this algorithm obtains a highly accurate and dense disparity

improves the matching effect of weak texture areas and depth discontinuities

and the accuracy of disparity. At the same time

it has strong robustness and can suppress the influence of certain brightness differences and noise.

关键词

Keywords

references

WANG X L , YANG L , WANG L R , et al . Characteristic point match algorithm based on the SURF in binocular stereo vision [C]// 2012 Fifth International Conference on Intelligent Networks and Intelligent Systems . Piscataway NJ,USA : IEEE , 2012 : 302 - 305 .

YIN Z , XIONG J . Stereovision measurement of layer geometry in wire and arc additive manufacturing with various stereo matching algorithms [J]. Journal of Manufacturing Processes , 2020 , 56 : 428 - 438 .

SU C , TAN G , LUO Y . Research on stereo matching technology based on binocular vision [J]. Open Access Library Journal , 2019 , 6 ( 9 ): 1 - 10 .

CHENG J . Three-dimensional reconstruction of binocular stereo vision based on improved SURF algorithm and KD-Tree matching algorithm [J]. Journal of Digital Information Management , 2015 , 13 ( 6 ): 462 - 466 .

WANG N , PENG B B , ZHU D , et al . Stereo matching for binocular underwater images using SURF operator and epipolar restriction [C]// Life System Modeling and Simulation . Berlin Heidelberg,Ger : Springer , 2014 : 378 - 386 .

王阳萍 , 秦安娜 , 郝旗 , 等 . 结合加速鲁棒特征的遥感影像半全局立体匹配 [J]. 光学学报 , 2020 , 40 ( 16 ): 163 - 171 .

WANG Y P , QIN A N , HAO Q , et al . Semi-Global stereo matching of remote sensing images combined with speeded up robust features [J]. Acta Optica Sinica , 2020 , 40 ( 16 ): 163 - 171 . (in Chinese)

FENG H , ZHANG G , HU B , et al . Noise-resistant matching algorithm integrating regional information for low-light stereo vision [J]. Journal of Electronic Imaging , 2019 , 28 ( 1 ): 013050.1 - 013050.10 .

HUI J , YANG Y , HUI Y , et al . Research on identify matching of object and location algorithm based on binocular vision [J]. Journal of Computational and Theoretical Nanoscience , 2016 , 13 ( 3 ): 2006 - 2013 .

肖进胜 , 田红 , 邹文涛 , 等 . 基于斜平面平滑优化的半全局立体匹配 [J]. 电子学报 , 2018 , 46 ( 8 ): 1835 - 1841 .

XIAO J S , TIAN H , ZOU W T , et al . Semi-global matching algorithm based on improved slanted plane smoothing [J]. Acta Electronica Sinica , 2018 , 46 ( 8 ): 1835 - 1841 . (in Chinese)

GUO S , YANG X . Fast recognition algorithm for static traffic sign information [J]. Open Physics , 2018 , 16 ( 1 ): 1149 - 1156 .

MENG Q , LU X , ZHANG B , et al . Research on the ROI registration algorithm of the cardiac CT image time series [J]. Biomedical Signal Processing and Control , 2018 , 40 : 71 - 82 .

LIN C , LI Y , XU G , et al . Optimizing ZNCC calculation in binocular stereo matching [J]. Signal Processing: Image Communication , 2017 , 52 : 64 - 73 .

MEN Y , ZHANG G , MEN C , et al . A sub-pixel disparity refinement algorithm based on lagrange interpolation [J]. Chinese Journal of Electronics , 2017 , 26 ( 4 ): 784 - 789 .

ZHANG Q , XU L , JIA J . 100+ times faster weighted median filter(WMF) [C]// 2014 IEEE Conference on Computer Vision and Pattern Recognition . Columbus OH, USA : IEEE , 2014 : 2830 - 2837 .

毛昕蓉 , 王楠 . 基于ADCensus的改进双目立体匹配算法 [J]. 电子产品世界 , 2020 , 27 ( 4 ): 62 - 64,87 .

MAO X R , WANG N . Improved binocular stereo matching algorithm based on ADCensus [J]. Electronics World , 2020 , 27 ( 4 ): 62 - 64+87 .

ALLABERDIEV S , YAKHYOEV S , FATKHULLAYEV R , et al . Speeded-up robust feature matching algorithm based on image improvement technology [J]. Journal of Computer and Communications , 2019 , 7 ( 12 ): 1 - 10 .

欧阳鑫玉 , 张娟娟 , 赵楠楠 , 等 . 基于NCC的改进立体匹配算法 [J]. 微型机与应用 , 2015 , 34 ( 3 ): 54 - 57 .

OUYANG X Y , ZHANG J J , ZHAO N N , et al . Improved stereo matching algorithm based on NCC [J]. Microcomputer & Its Applications , 2015 , 34 ( 3 ): 54 - 57 . (in Chinese)

HUANG S , BI Y , XU X . Research and implementation of binocular stereo matching algorithms [J]. Journal of Ludong University(Natural Science Edition) , 2018 , 34 ( 1 ): 25 - 30 .

LIU Y , HUANG W , WANG Y . A new stereo matching method for RAW image data based on improved SGBM [C]// Three-Dimensional Image Acquisition and Display Technology and Applications . Bellingham,USA : SPIE , 2018 : 108450W .

ZHU S , GAO R , LI Z . Stereo matching algorithm with guided filter and modified dynamic programming [J]. Multimedia Tools and Applications , 2017 , 76 ( 1 ): 199 - 216 .

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于Star-RTMPose的双目视觉定位与测量

遮挡检测/立体匹配中的分段动态规划法

一种基于Integral Imaging和多基线立体匹配算法的深度测量方法

基于双目立体视觉的偏转线圈测量方法研究

基于相位的尺度自适应立体匹配方法