相互结构引导滤波TV-L1变分光流估计

doi:10.3969/j.issn.0372-2112.2019.03.027

电子学报 ›› 2019, Vol. 47 ›› Issue (3): 707-713.DOI: 10.3969/j.issn.0372-2112.2019.03.027

相互结构引导滤波TV-L1变分光流估计

葛利跃¹, 张聪炫^1,2, 陈震^1,2, 黎明², 陈昊²

1. 南昌航空大学测试与光电工程学院, 江西南昌 330063;
2. 南昌航空大学无损检测技术教育部重点实验室, 江西南昌 330063

收稿日期:2018-03-12 修回日期:2018-07-09 出版日期:2019-03-25
- 通讯作者:
- 张聪炫
- 作者简介:
- 葛利跃 男,1992年10月出生于安徽省蚌埠市.现为南昌航空大学测试与光电工程学院硕士研究生.主要研究方向为图像检测与智能识别.E-mail:lygeah@163.com
- 基金资助:
- 国家自然科学基金 (No.61866026，No.61772255，No.61866025）; 江西省优势科技创新团队计划 (No.20152BCB24004，No.20165BCB19007）、航空科学基金 (No.2016ZC56005）; 江西省青年科学基金 (No.20171BAB212012）; 江西省重点研发计划 (No.20161BBE50080）; 江西省研究生创新专项资金项目资助 (No.YC2017-S339）

Mutual-Structure Guided Filtering Based TV-L1 Optical Flow Estimation

GE Li-yue¹, ZHANG Cong-xuan^1,2, CHEN Zhen^1,2, LI Ming², CHEN Hao²

1. School of Measuring and Optical Engineering, Nanchang Hangkong University, Nanchang, Jiangxi 330063, China;
2. Key Laboratory of Nondestructive Testing, Ministry of Education, Nanchang Hangkong University, Nanchang, Jiangxi 330063, China

Received:2018-03-12 Revised:2018-07-09 Online:2019-03-25 Published:2019-03-25
- Supported by:
- National Natural Science Foundation of China (No.61866026, No.61772255, No.61866025); Superior Science and Technology Innovation Team Project of Jiangxi Province (No.20152BCB24004, No.20165BCB19007); Aeronautical Science Foundation of China, ASFC (No.2016ZC56005); Youth Science Foundation of Jiangxi Province (No.20171BAB212012); Key R&D Program of Jiangxi Province (No.20161BBE50080); Graduate Innovation Foundation of Jiangxi Province (No.YC2017-S339)

摘要/Abstract

摘要： 由于光流场既包含物体的运动信息，又包含场景的三维结构信息，因此光流计算技术是计算机视觉和机器视觉领域研究的重要任务之一.针对现有光流计算方法在图像边缘保护方面存在过度平滑问题，提出一种基于相互结构引导滤波的TV-L1（Total Variational with L1 norm，TV-L1）变分光流估计方法.通过提取置信度较高的图像相互结构区域，构造基于相互结构引导滤波的全局目标函数，并采用金字塔分层细化与交替迭代方案结合的策略进行优化，该方法可以较好的保护图像边缘信息.最后采用标准测试图像集对本文方法与现有代表性变分方法LDOF（Large Displacement Optical Flow，LDOF），CLG-TV（Combined Local-Global Total Variation，CLG-TV），Classic++，NNF（Nearest Neighbor Fields，NNF）以及深度学习方法FlowNet2.0进行对比，实验结果表明本文方法具有较高的光流估计精度与鲁棒性，尤其对图像边缘保护具有显著的效果，并且在运动目标检测，机器人避障等方面具有一定应用前景.

关键词: 光流计算, 计算机视觉, 机器视觉, 图像边缘保护, 图像相互结构, 深度学习, 运动目标检测, 机器人避障

Abstract: Because the optical flow field contains both the motion information of the object and the three-dimensional structure information of the scene,optical flow calculation technology is one of the important tasks in the field of computer vision and machine vision.But,for the existing optical flow methods,there is over-smoothing problem in image boundary preserving.This paper proposes a global TV-L1(Total Variational with L1 norm,TV-L1) variational optical flow computation method based on the mutual-structure guided filtering.By extracting the mutual-structural regions of the image with higher confidence,we construct the global mutual-structure guided filtering objective function,and optimize the algorithm via combining the pyramid layering strategy with the alternating iteration scheme.This method can better preserve the image boundary information.Finally,we compare the proposed method with the existing representative variational methods LDOF(Large Displacement Optical Flow,LDOF),CLG-TV(Combined Local-Global Total Variation,CLG-TV),Classic++,NNF(Nearest Neighbor Fields,NNF) and deep learning method FlowNet2.0 by using standard test image datasets.The experimental results demonstrate that the presented method has more accuracy and better robustness than the other evaluated methods,especially has the significant effect of boundary preserving in the areas,and it has application prospects in moving target detection,robot obstacle avoidance,and so on.

Key words: optical flow calculation, computer vision, machine vision, image boundary preserving, image mutual-structure, deep learning, moving target detection, robot obstacle avoidance

中图分类号:

TP391

葛利跃, 张聪炫, 陈震, 等. 相互结构引导滤波TV-L1变分光流估计[J]. 电子学报, 2019, 47(3): 707-713.

GE Li-yue, ZHANG Cong-xuan, CHEN Zhen, et al. Mutual-Structure Guided Filtering Based TV-L1 Optical Flow Estimation[J]. Acta Electronica Sinica, 2019, 47(3): 707-713.

参考文献

[1] Sanchez-Garcia A J,Rios-Figueroa H V,Marin-Hernandez A,et al.Decision making for obstacle avoidance in autonomous mobile robots by time to contact and optical flow[A].Electronics,Communications and Computers[C].Puebla:IEEE,2015,130-134.
[2] 耿凤欢,刘慧,郭强,等.基于变分光流估计的肺部4D-CT图像超分辨率重建[J].计算机研究与发展,2017,54(8):1703-1712.Geng Fenghuan,Liu Hui,Guo Qiang,et al.Variational optical flow estimation based super-resolution reconstruction for lung 4D-CT image[J].Journal of Computer Research and Development.2017,54(8):1703-1712.(in Chinese).
[3] 张聪炫,陈震,黎明.单目图像序列光流三维重建技术研究综述[J].电子学报,2016,44(12):3044-3052.ZHANG Cong-xuan,CHEN Zhen,LI Ming.Review of the 3D reconstruction technology based on optical flow of monocular image sequence[J].Acta Electronica Sinica,2016,44(12):3044-3052.(in Chinese).
[4] Drulea M,Nedevschi S.Total variation regularization of local-global optical flow[A].IEEE International Conference on Intelligent Transportation Systems[C].Anchorage:IEEE,2012.318-323.
[5] Zimmer H,Bruhn A,Weickert J.Optic flow in harmony[J].International Journal of Computer Vision,2011,93(3):368-388.
[6] Brox T,Malik J.Large displacement optical flow:Descriptor matching in variational motion estimation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(3):500-513.
[7] 刘骏,祖静,张瑜,等.光照变化条件下的光流估计[J].中国图象图形学报,2014,19(10):1475-1480.Liu Jun,Zu Jing,Zhang Yu,et al.Optical flow estimation method under the condition of illuminationchange[J].Jounal of Image and Graphics,2014,19(10):1475-1480.(in Chinese).
[8] Xiao J,Cheng H,Sawhney H,et al.Bilateral filtering-based optical flow estimation with occlusion detection[A].European Conference on Computer Vision[C].Graz:Springer,2006.211-224.
[9] Sun D,Roth S,Black M J.A quantitative analysis of current practices in optical flow estimation and the principles behind them[J].International Journal of Computer Vision,2014,106(2):115-137.
[10] Shen X,Zhou C,Xu L,et al.Mutual-structure for joint filtering[J].International Journal of Computer Vision,2017,125(1):19-33.
[11] Chen Z,Jin H,Lin Z,et al.Large displacement optical flow from nearest neighbor fields[A].IEEE International Conference on Computer Vision and Pattern Recognition[C].Portland:IEEE,2013.2443-2450.
[12] Ilg E,Mayer N,Saikia T,et al.Flownet 2.0:Evolution of optical flow estimation with deep networks[A].IEEE International Conference on Computer Vision and Pattern Recognition[C].Providence:IEEE,2017.2462-2470.

[1]	李钦, 刘伟, 牛朝阳, 宝音图, 惠周勃. 低信噪比下基于分裂EfficientNet网络的雷达信号调制方式识别[J]. 电子学报, 2023, 51(3): 675-686.
[2]	范兵兵, 何庭建, 张聪炫, 陈震, 黎明. 联合遮挡约束与残差补偿的特征金字塔光流计算方法[J]. 电子学报, 2023, 51(3): 648-657.
[3]	张聿远, 闫文君, 张立民. 基于多模态特征融合网络的空时分组码识别算法[J]. 电子学报, 2023, 51(2): 489-498.
[4]	许新征, 李杉. 基于特征膨胀卷积模块的轻量化技术研究[J]. 电子学报, 2023, 51(2): 355-364.
[5]	张永梅, 孙捷. 基于动静态特征双输入神经网络的咳嗽声诊断COVID-19算法[J]. 电子学报, 2023, 51(1): 202-212.
[6]	袁海英, 成君鹏, 曾智勇, 武延瑞. Mobile_BLNet：基于Big-Little Net的轻量级卷积神经网络优化设计[J]. 电子学报, 2023, 51(1): 180-191.
[7]	王神龙, 雍宇, 吴晨睿. 基于伪孪生神经网络的低纹理工业零件6D位姿估计[J]. 电子学报, 2023, 51(1): 192-201.
[8]	李滔, 董秀成, 林宏伟. 基于深监督跨尺度注意力网络的深度图像超分辨率重建[J]. 电子学报, 2023, 51(1): 128-138.
[9]	郭晓轩, 冯其波, 冀振燕, 郑发家, 杨燕燕. 多线激光光条图像缺陷分割模型研究[J]. 电子学报, 2023, 51(1): 172-179.
[10]	贾童瑶, 卓力, 李嘉锋, 张菁. 基于深度学习的单幅图像去雾研究进展[J]. 电子学报, 2023, 51(1): 231-245.
[11]	何滢婕, 刘月峰, 边浩东, 郭威, 张小燕. 基于Informer的电池荷电状态估算及其稀疏优化方法[J]. 电子学报, 2023, 51(1): 50-56.
[12]	吴靖, 叶晓晶, 黄峰, 陈丽琼, 王志锋, 刘文犀. 基于深度学习的单帧图像超分辨率重建综述[J]. 电子学报, 2022, 50(9): 2265-2294.
[13]	李雪莹, 王田路, 梁鹏, 王翀. 基于系统模型的用户评论中非功能需求的自动分类[J]. 电子学报, 2022, 50(9): 2079-2089.
[14]	琚长瑞, 秦晓燕, 袁广林, 李豪, 朱虹. 尺度敏感损失与特征融合的快速小目标检测方法[J]. 电子学报, 2022, 50(9): 2119-2126.
[15]	张志昌, 于沛霖, 庞雅丽, 朱林, 曾扬扬. SMGN：用于对话状态跟踪的状态记忆图网络[J]. 电子学报, 2022, 50(8): 1851-1858.

相互结构引导滤波TV-L1变分光流估计

Mutual-Structure Guided Filtering Based TV-L1 Optical Flow Estimation

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics