1. 南昌航空大学无损检测技术教育部重点实验室,江西,南昌,330063
2. 中国科学院自动化研究所,北京,100190
3. 南昌航空大学无损检测技术教育部重点实验室,江西,南昌,330063
4. 中国科学院自动化研究所,北京,100190
网络出版:2020-04-25,
纸质出版:2020
移动端阅览
陈震, 马龙, 张聪炫, 等. 基于语义分割的双目场景流估计[J]. 电子学报, 2020,48(4):631-636.
Binocular Scene Flow Estimation Based on Semantic Segmentation[J]. Acta Electronica Sinica, 2020, 48(4): 631-636.
陈震, 马龙, 张聪炫, 等. 基于语义分割的双目场景流估计[J]. 电子学报, 2020,48(4):631-636. DOI: 10.3969/j.issn.0372-2112.2020.04.002.
Binocular Scene Flow Estimation Based on Semantic Segmentation[J]. Acta Electronica Sinica, 2020, 48(4): 631-636. DOI: 10.3969/j.issn.0372-2112.2020.04.002.
针对现有场景流计算方法在复杂场景、大位移和运动遮挡等情况下易产生运动边缘模糊的问题,提出一种基于语义分割的双目场景流估计方法.首先,根据图像中的语义信息类别,通过深度学习的卷积神经网络模型将图像划分为带有语义标签的区域;针对不同语义类别的图像区域分别进行运动建模,利用语义知识计算光流信息并通过双目立体匹配的半全局匹配方法计算图像视差信息.然后,对输入图像进行超像素分割,通过最小二乘法耦合光流和视差信息,分别求解每个超像素块的运动参数.最后,在优化能量函数中添加语义分割边界的约束信息,通过更新像素到超像素块的映射关系和超像素块到移动平面的映射关系得到最终的场景流估计结果.采用KITTI 2015标准测试图像序列对本文方法和代表性的场景流计算方法进行对比分析.实验结果表明,本文方法具有较高的精度和鲁棒性,尤其对于复杂场景、运动遮挡和运动边缘模糊的图像具有较好的边缘保护作用.
In order to address the issue of motion boundary blurring caused by the complex scenes
large displacement and motion occlusion
this paper proposes a binocular scene flow estimation method based on semantic segmentation. Firstly
by using the image semantic information
we classify the image regions into several categories with semantic labels through convolutional neural networks. Then we plan the motion models of various image regions according to the different semantic categories and compute the optical flow and disparity under the prior knowledge of semantic information. Secondly
we apply the superpixel segmentation to the input image and couple the optical flow and disparity information via least squares method to solve the motion parameters of each superpixel patch. Finally
we add the boundary information of semantic segmentation constraint to the optimization energy function
and estimate the scene flow by updating the mappings of pixels-to-superpixel and superpixel-to-plane. We evaluate the proposed approach and some state-of-the-art methods on the KITTI 2015 database to conduct a comparison experiment. The experimental results demonstrate that our method has high accuracy and good robustness
and especially has significant benefit of boundary preserving in the areas of complex scene
motion occlusion and motion boundary.
0
浏览量
164
下载量
2
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621