基于图像局部结构的区域匹配变分光流算法

doi:10.3969/j.issn.0372-2112.2015.11.010

电子学报 ›› 2015, Vol. 43 ›› Issue (11): 2200-2209.DOI: 10.3969/j.issn.0372-2112.2015.11.010

基于图像局部结构的区域匹配变分光流算法

陈震^1,2, 张聪炫^1,2, 晏文敬¹, 吴燕平¹

1. 南昌航空大学测试与光电工程学院, 江西南昌 330063;
2. 无损检测技术教育部重点实验室, 江西南昌 330063

收稿日期:2014-05-23 修回日期:2014-10-16 出版日期:2015-11-25
- 通讯作者:
- 陈震
- 作者简介:
- 张聪炫 男,1984年7月出生,河南焦作人.分别于2007年、2014年在南昌航空大学和南京航空航天大学获得学士、博士学位.现为南昌航空大学讲师,硕士生导师,主要研究方向为图像检测与智能识别.E-mail:zcxdsg@163.com
- 基金资助:
- 国家自然科学基金 (No.U1233125,No.61462062,No.61401190); 江西省主要学科学术带头人培养计划项目 (No.201208421); 江西省自然科学基金重点项目 (No.20133ACB20004); 江西省科技落地计划项目 (No.201408083); 航空科学基金 (No.11ZC56003,No.2013ZC56005); 江西省自然科学基金 (No.20114BAB201044)

Region Matching Variational Optical Flow Algorithm Based on Image Local Structure

CHEN Zhen^1,2, ZHANG Cong-xuan^1,2, YAN Wen-jing¹, WU Yan-ping¹

1. School of Measuring and Optical Engineering, Nanchang Hangkong University, Nanchang, Jiangxi 330063 China;
2. Key Laboratory of Nondestructive Testing, Ministry of Education, Nanchang, Jiangxi 330063 China

Received:2014-05-23 Revised:2014-10-16 Online:2015-11-25 Published:2015-11-25
- Supported by:
- National Natural Science Foundation of China (No.U1233125, No.61462062, No.61401190); Key Disciplines Academic Leader Cultivation Plan of Jiangxi Province (No.201208421); Key Program of Natural Science Foundation of Jiangxi Province, China (No.20133ACB20004); and Technology Program of Jiangxi Province (No.201408083); Aeronautical Science Foundation of China, ASFC (No.11ZC56003, No.2013ZC56005); Natural Science Foundation of Jiangxi Province, China (No.20114BAB201044)

摘要/Abstract

摘要：

针对变分光流算法的计算精度与鲁棒性问题,提出一种基于图像局部结构的区域匹配变分光流算法.光流估计能量泛函的数据项采用图像结构守恒与灰度守恒相结合,并引入规则化非平方惩罚函数,保证了光流估计的精度与鲁棒性;平滑项采用随图像局部结构自适应变化的扩散策略结合区域匹配约束函数能够有效地保护运动物体或场景的边缘轮廓信息;在光流计算过程中引入金字塔分层细化策略克服图像序列中大位移运动引起的像素点漂移现象,并采用数学方法证明光流估计模型的鲁棒性和收敛性.多组实验表明,本文方法在图像中存在剧烈光照变化、非刚性物体复杂运动以及多目标大位移运动等情况下具有较高的计算精度、较好的鲁棒性.

关键词: 变分光流, 图像局部结构, 自适应扩散, 区域匹配

Abstract:

A region matching variational optical flow algorithm based on image local structure according to the computing accuracy and robustness of the variational optical flow method is proposed.Firstly,the data term of the optical flow estimation energy function combines the constancy of the image structure and constancy of the grey value,which introduces a penalty function to ensure the good accuracy and robustness of the optical flow computing.Secondly,the smoothing term uses an adaptive nonlinear diffusion function which related to the image structure to preserve the boundaries of the motion.Finally,the region matching strategy and the coarse-to-fine method are used to compute the large displacement optical flow,and then the robustness and convergence are proved by mathematical method.Several experiments prove that the proposed algorithm has the better precisionand robustness even there are terrible illumination changes,complex motion of non-rigid object and large displacement of multiple objects.

Key words: variational optical flow, image local structure, adaptive diffusion, region matching

中图分类号:

TP391

陈震, 张聪炫, 晏文敬, 等. 基于图像局部结构的区域匹配变分光流算法[J]. 电子学报, 2015, 43(11): 2200-2209.

CHEN Zhen, ZHANG Cong-xuan, YAN Wen-jing, et al. Region Matching Variational Optical Flow Algorithm Based on Image Local Structure[J]. Acta Electronica Sinica, 2015, 43(11): 2200-2209.

参考文献

[1] Hérissé B,Hamel T,Mahony R,et al.Landing a VTOL unmanned aerial vehicle on a moving platform using optical flow[J]. IEEE Transactions onRobotics,2012,28(1):77-89.
[2] Holte M B,Moeslund T B,Fihl P.View invariant gesture recognition using 3D optical flow and harmonic motion context[J]. Computer Vision and Image Understanding,2010,114(12):1353-1361.
[3] 许鸿奎,江铭炎,杨明强.基于改进光流场模型的脑部多模医学图像配准[J]. 电子学报,2012,40(3):525-529. Xu H K,Jiang M Y,Yang M Q.Registration of Multimodal Brain Medical Images Based on Improved Optical Flow Model[J]. Acta Electronica Sinica,2012,40(3):525-529.(in Chinese)
[4] Horn K P,Schunck B G.Determining optical flow[J]. Artificial Intelligence,1981,17(1-3):185-204.
[5] Lucas B D,Kanade T.An iterative image registration technique with an application to stereo vision[A]. Proceedings of the 7^th international joint conference on Artificial intelligence[C]. Vienna:Springer,1981.674-679.
[6] Barron J L,Fleet D J,Beauchemin S S.Performance of optical flow techniques[J]. International journal of computer vision,1994,12(1):43-77.
[7] Papenberg N,Bruhn A,Brox T,et al.Highly accurate optic flow computation with theoretically justified warping[J]. International Journal of Computer Vision,2006,67(2):141-158.
[8] Drulea M,Nedevschi S.Total variation regularization of local-global optical flow[A]. 14^th Conference on Intelligent Transportation Systems[C]. Washington DC:IEEE,2011.318-323.
[9] 项学智,开湘龙,张磊,等.一种变分偏微分多模型光流求解方法[J]. 仪器仪表学报,2014,35(1):109-116. Xiang X Z,Kai X L,Zhang L,et al.A method variational partial differential based multi-model optical flow calculation[J]. Chinese Journal of Scientific Instrument,2014,35(1):109-116.(in Chinese)
[10] 涂志刚,谢伟,熊淑芬,等.一种高精度的 TV-L1 光流算法[J]. 武汉大学学报:信息科学版,2012,37(4):496-499. Tu Z G,Xie W,Xiong S F,et al.An Efficient TV-L1 optical flow method[J]. Geomatics and Information Science of Wuhan University,2012,37(4):496-499.(in Chinese)
[11] Werlberger M,Trobin W,Pock T,et al.Anisotropic huber-L1 optical flow[A]. Proceedings of the British machine vision conference[C]. London:BMVA,2009.1-11.
[12] Xu L,Jia J,Matsushita Y.Motion detail preserving optical flow estimation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2012,34(9):1744-1757.
[13] Zimmer H,Bruhn A,Weickert J.Optic flow in harmony[J]. International Journal of Computer Vision,2011,93(3):368-388.
[14] 梅广辉,陈震,危水根,等.图像光流联合驱动的变分光流计算新方法[J]. 中国图象图形学报,2011,16(12):2159-2168. Mei G H,Chen Z,Wei S G,et al.New algorithm for estimation of variational optical flow with image-and flow-driven[J]. Journal of Image and Graphics,2011,16(12):2159-2168.(in Chinese)
[15] Sun D,Roth S,Black M J.Secrets of optical flow estimation and their principles[A]. IEEE Conference on Computer Vision and Pattern Recognition[C]. San Francisco:IEEE,2010.2432-2439.
[16] Brox T,Malik J.Large displacement optical flow:descriptor matching in variational motion estimation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(3):500-513.
[17] Brox T,Bruhn A,Papenberg N,et al.High accuracy optical flow estimation based on a theory for warping[A]. 8^th European Conference on Computer Vision[C]. Prague:Springer,2004.25-36.
[18] Amiaz T,Lubetzky E,Kiryati N.Coarse to over-fine optical flow estimation[J]. Pattern recognition,2007,40(9):2496-2503.
[19] Zhang C X,Chen Z,Li M,et al.Anisotropic optical flow algorithm based on self-adaptive cellular neural network[J]. Journal of Electronic Imaging,2013,22(1):013038.
[20] Baker S,Scharstein D,Lewis J P,et al.A Database and Evaluation Methodology for Optical Flow[J]. International Journal of Computer Vision,2011,92(1):1-31.
[21] Sun D,Roth S,Black M J.A quantitative analysis of current practices in optical flow estimation and the principles behind them[J]. International Journal of Computer Vision,2014,106(2):115-137.

基于图像局部结构的区域匹配变分光流算法

Region Matching Variational Optical Flow Algorithm Based on Image Local Structure

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 3

编辑推荐

Metrics

[1]	余旺盛, 田孝华, 侯志强, 黄安奇, 刘翔. 基于关键区域特征匹配的视觉跟踪算法[J]. 电子学报, 2014, 42(11): 2150-2156.
[2]	丁辉, 付梦印, 王美玲. 基于NSCT的SMP立体匹配算法研究[J]. 电子学报, 2008, 36(4): 772-776.
[3]	戴声扬, 章毓晋. 图像检索中的两层描述和非对称区域匹配[J]. 电子学报, 2005, 33(4): 725-729.