1. 南昌航空大学无损检测技术教育部重点实验室,江西,南昌,330063
2. 中国科学院自动化研究所,北京,100190
3. 南昌航空大学无损检测技术教育部重点实验室,江西,南昌,330063
4. 中国科学院自动化研究所,北京,100190
纸质出版:2021
移动端阅览
吴俊劼, 陈震, 张聪炫, 等. 基于特征级联卷积网络的双目立体匹配[J]. 电子学报, 2021,49(4):690-695.
WU Jun-jie, CHEN Zhen, ZHANG Cong-xuan, et al. Binocular Stereo Matching Based on Feature Cascade Convolutional Network[J]. Acta Electronica Sinica, 2021, 49(4): 690-695.
吴俊劼, 陈震, 张聪炫, 等. 基于特征级联卷积网络的双目立体匹配[J]. 电子学报, 2021,49(4):690-695. DOI: 10.12263/DZXB.20190135.
WU Jun-jie, CHEN Zhen, ZHANG Cong-xuan, et al. Binocular Stereo Matching Based on Feature Cascade Convolutional Network[J]. Acta Electronica Sinica, 2021, 49(4): 690-695. DOI: 10.12263/DZXB.20190135.
针对图像序列病态区域匹配歧义性以及稠密视差图连通性的问题,本文提出一种基于特征级联卷积神经网络的双目立体匹配计算方法.构造特征重用的全卷积密集块,利用"跳连接"机制将浅层提取的特征图级联到后续子层,对深层卷积丢失的局部特征信息进行补偿.引入指示函数划分一定大小的训练集,将其批量输入特征级联卷积网络模型进行前向传播,同时通过小批量梯度下降(Mini-Batch Gradient Descent,MBGD)策略更新初始权重和偏置参数.根据负连接神经元对网络模型的输出进行初始匹配代价计算,并利用十字交叉域代价聚合(Cross Based Cost Aggregation,CBCA)和半全局立体匹配(Semi-Global Matching,SGM)等算法对代价函数进行优化,求得精准稠密的视差图.分别采用Middlebury数据库提供的训练和测试立体图像集对本文方法和深度学习方法MC-CNN、CBMV、MC-CNN-WS等具有代表性方法进行对比测试.实验结果表明,本文方法具有较高的视差计算精度和鲁棒性,尤其对复杂场景、光照变化以及弱纹理等困难场景图像序列能有效提高匹配率和保持图像细节.
In order to overcome the ambiguity of ill-posed regions matching while enhancing the connectivity of dense disparity map
this paper proposes a binocular stereo matching method based on feature cascade convolutional neural network. We constructed a fully convolutional densely block with feature reuse to utilize the "skip-connection" mechanism to transmit the feature maps extracted from the previous layers to all subsequent layers
and compensated the local feature information of deep convolution losing. At the forward propagation stage
we designed an indicator function to divide a certain size of the training set as the input of the feature cascade convolutional network model
and applied the Mini-Batch Gradient Descent (MBGD) strategy to update the initial weight and bias parameters. We computed the initial matching cost according to the output of the presented network model
and used the Cross Based Cost Aggregation (CBCA) and Semi-Global Matching (SGM) pipeline to optimize the cost function for generating the accurate and dense disparity map. We used the published training and test sets of Middlebury database to evaluate our approach and other representative stereo matching methods
such as MC-CNN
CBMV and MC-CNN-WS. The experimental results prove that the proposed method has higher accuracy and better robustness of disparity estimation
and especially improves the matching rate and preserves image details in the regions of complex scene
illumination change and weakly textured.
0
浏览量
3
下载量
1
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621