National Natural Science Foundation of China (No.61866026, No.61772255, No.61866025);Superior Science and Technology Innovation Team Project of Jiangxi Province (No.20165BCB19007);Science and Technology Innovation Outstanding Young Talent Program of Jiangxi Province (No.20192BCB23011);Aeronautical Science Foundation of China, ASFC (No.2018ZC56008);China Postdoctoral Science Foundation (No.2019M650894)
RGBD Scene Flow Estimation Based on FRFCM Clustering and Depth Optimization[J]. Acta Electronica Sinica, 2020, 48(7): 1380-1386.
DOI:
RGBD Scene Flow Estimation Based on FRFCM Clustering and Depth Optimization[J]. Acta Electronica Sinica, 2020, 48(7): 1380-1386. DOI: 10.3969/j.issn.0372-2112.2020.07.018.
RGBD Scene Flow Estimation Based on FRFCM Clustering and Depth Optimization
针对现有RGBD场景流计算模型在复杂场景、非刚性运动和运动遮挡等情况下易产生场景过度平滑和运动边缘模糊的问题,提出一种基于FRFCM(Fast and Robust Fuzzy C-Means)聚类与深度优化的RGBD场景流计算方法.首先以图像序列连续帧间光流信息为基准,利用FRFCM聚类算法对输入图像进行初始分割,然后根据深度图像的运动边缘信息优化初始分割结果,提取高置信度的运动分层信息.最后设计基于图像分割的RGBD场景流能量函数,采用金字塔变形策略计算精确的场景流结果.分别采用Middlebury和MPI-Sintel数据库所提供的测试图像集对本文方法和现有的RGBD场景流算法进行综合对比分析,实验结果表明本文方法相对于其他方法具有更好的场景流估计精度和鲁棒性,有效改善了场景过度平滑和运动边缘模糊问题.
Abstract
In order to address the issues of scene over-smoothing and motion edge-blurring caused by the existing RGBD scene flow methods under complex scenes
non-rigid movement and motion occlusions
this paper proposes a RGBD scene flow method based on FRFCM (Fast and Robust Fuzzy C-Means) clustering and depth optimization. First
the optical flow information from the consecutive frames is marked as the benchmark and the FRFCM clustering approach is utilized to obtain the initial segmentation of the input image sequences. Second
according to the motion edge information of the depth image
we further optimize the initial segmentation to extract the high-confidence hierarchical motion information. Finally
an energy function of RGBD scene flow based on image segmentation is designed
and the pyramid warping strategy is adopted to compute the scene flow field. We employ the test sets of Middlebury and MPI-Sintel databases to conduct a comparison experiment between the proposed method and the existing RGBD scene flow methods. The experimental results indicate that the proposed method has better accuracy and robustness of scene flow estimation
especially when dealing with the issues of scene over-smoothing and motion edge-blurring.