1. 南昌航空大学无损检测技术教育部重点实验室,江西,南昌,330063
2. 中国科学院自动化研究所,北京,100190
3. 南昌航空大学无损检测技术教育部重点实验室,江西,南昌,330063
4. 中国科学院自动化研究所,北京,100190
网络出版:2020-09-25,
纸质出版:2020
移动端阅览
张聪炫, 周仲凯, 陈震, 等. 深度学习光流计算技术研究进展[J]. 电子学报, 2020,48(9):1841-1849.
ZHANG Cong-xuan, ZHOU Zhong-kai, CHEN Zhen, et al. Research Progress of Deep Learning Based Optical Flow Computation Technology[J]. Acta Electronica Sinica, 2020, 48(9): 1841-1849.
张聪炫, 周仲凯, 陈震, 等. 深度学习光流计算技术研究进展[J]. 电子学报, 2020,48(9):1841-1849. DOI: 10.3969/j.issn.0372-2112.2020.09.023.
ZHANG Cong-xuan, ZHOU Zhong-kai, CHEN Zhen, et al. Research Progress of Deep Learning Based Optical Flow Computation Technology[J]. Acta Electronica Sinica, 2020, 48(9): 1841-1849. DOI: 10.3969/j.issn.0372-2112.2020.09.023.
图像序列光流计算是图像处理与计算机视觉等领域的重要研究方向.随着深度学习技术的快速发展,以卷积神经网络为代表的深度学习理论与方法成为光流计算技术研究的热点.本文主要对深度学习光流计算技术研究进行综述,首先介绍了有监督学习、无监督学习和半监督学习的光流计算网络模型与训练策略,然后重点阐述并分析了不同网络模型优化方法.针对光流计算模型的评估问题,分别介绍了Middlebury、MPI-Sintel和KITTI等数据库及评价基准,并对不同类型深度学习和传统变分光流模型进行对比与分析.最后,总结了深度学习光流计算技术在模型复杂度与泛化性、光流估计鲁棒性、小样本训练准确性等方面的关键技术问题,并指出了可能的解决方案与研究思路.
Optical flow computation is an important research direction in image processing and computer vision. With the rapid development of the deep learning technology
the convolutional neural network based deep learning theories and methodologies have been the research focus of optical flow computation. This article mainly reviews the research progress of the deep learning based optical flow estimation technologies. First
the typical models and training strategies of the optical flow computing networks with supervised learning
unsupervised learning and semi-supervised learning are introduced. Second
the optimization methods of various network models are described and analyzed. Third
the evaluation benchmarks of Middlebury
MPI-Sintel and KITTI databases are summarized
and the experimental comparison results and analysis between the different deep-learning and variational optical flow methods are conducted. Finally
we discuss some issues of the deep learning based optical flow computation technology including the model complexity and generalization
the robustness of optical flow estimation and the accuracy of the small sample training. Afterwards
we point out several possible solutions and research ideas to address the above mentioned issues.
0
浏览量
97
下载量
2
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621