一种可克服头动影响的视线跟踪系统

doi:10.3969/j.issn.0372-2112.2013.12.013

电子学报 ›› 2013, Vol. 41 ›› Issue (12): 2403-2408.DOI: 10.3969/j.issn.0372-2112.2013.12.013

一种可克服头动影响的视线跟踪系统

秦华标, 严伟洪, 王信亮, 余翔宇

华南理工大学电子与信息学院, 广东广州 510640

收稿日期:2013-04-23 修回日期:2013-05-30 出版日期:2013-12-25
- 作者简介:
- 秦华标 男，1967年出生于湖南省张家界市，现为华南理工大学电子信息学院教授，主要研究方向为智能信息处理、无线通信、嵌入式系统与FPGA设计. 严伟洪 男，1987年出生于广东省清远市，2010年毕业于中山大学，现为华南理工大学电子信息学院在读硕士研究生，主要研究方向为计算机视觉、图像处理以及人机交互.
- 基金资助:
- 国家自然科学基金 (No.60972136）; 广东省科技计划项目 (No.2010B010600014）

A Gaze Tracking System Overcoming Influences of Head Movements

QIN Hua-biao, YAN Wei-hong, WANG Xin-liang, YU Xiang-yu

School of Electronic and Information Engineering, South China University of Technology, Guangzhou, Guangdong 510640, China

Received:2013-04-23 Revised:2013-05-30 Online:2013-12-25 Published:2013-12-25
- Supported by:
- National Natural Science Foundation of China (No.60972136); Program of Science and Technology Project of Guangdong Province (No.2010B010600014)

摘要/Abstract

摘要： 本文提出一种基于单目摄像头和四红外光源的视线跟踪系统.通过四个红外光源在眼睛角膜上产生的四个光斑的中心与瞳孔中心建立新型的瞳孔角膜反射向量，该向量对头部运动具有较好的鲁棒性；此外通过设定感兴趣区域提高人眼定位速度，利用模板匹配与凸包方法精确定位瞳孔中心，并采用点匹配法正确识别光斑中心，确保了视线跟踪的实时性和精度.实验结果证明该系统较好地解决了视线跟踪精度不高和头部运动受限的问题，并且满足实时性要求.

关键词: 视线跟踪, 头部运动, 瞳孔, 瞳孔角膜反射向量

Abstract: A gaze tracking system based on single camera and four IR light sources is proposed in this paper.With pupil's center and four reflection centers on corneal generated from the IR light sources,a novel pupil-corneal reflection vector is constructed,which is invariant to head movements.In addition,the region of interest is applied to improve the speed of eye location;template matching and convex hull are used to locate pupil's center;point matching is used to identify the reflection centers.These methods guarantee the real-time performance and accuracy of the gaze tracking.The experiment results demonstrate the improved accuracy and the real-time performance of the system with less constraint on head movements.

Key words: gaze tracking, head movements, pupil, pupil-corneal reflection vector

中图分类号:

TP391.4

秦华标, 严伟洪, 王信亮, 等. 一种可克服头动影响的视线跟踪系统[J]. 电子学报, 2013, 41(12): 2403-2408.

QIN Hua-biao, YAN Wei-hong, WANG Xin-liang, et al. A Gaze Tracking System Overcoming Influences of Head Movements[J]. Acta Electronica Sinica, 2013, 41(12): 2403-2408.

参考文献

［1］Dan Witzner Hansen,Qiang Ji.In the eye of the beholder:a survey of models for eyes and gaze［J］.IEEE Transactions on Pattern Analysis and Machine Intelligence,2010,32(3):478-500.
［2］Zhiwei Zhu,Qiang Ji.Eye and gaze tracking for interactive graphic display［J］.Machine Vision and Applications,2004,15(3):139-148.
［3］Zhiwei Zhu,Qiang Ji,KP Bennett.Nonlinear eye gaze mapping function estimation via support vector regression［A］.Proceedings of the 18th International Conference on Pattern Recognition［C］.Hong Kong,China:IEEE Press,2006.1132-1135.
［4］张闯，迟健男，张朝晖，王志良.一种基于立体视觉的视线估计方法［J］.电子学报，2010,38(5)：1008-1013.
ZHANG Chuang,CHI Jian-nan,ZHANG Zhao-hui,WANG Zhi-liang.A novel gaze estimation method based on stereo vision［J］.Acta Electronica Sinica,2010,38(5):1008-1013.(in Chinese)
［5］CH Morimoto,D Koons,A Amir,M Flickner.Pupil detection and tracking using multiple light sources［J］.Image and Vision Computing,2000,18(4):331-336.
［6］程成,杜菁菁,蓝飞翔.眼动交互的实时线性算法构造和实现［J］.电子学报，2009，37(4A)：12-15.
CHENG Cheng,DU Jing-jing,LAN Fe-i xiang.Research and realization on real-time linear prediction algorithm for desktop eye-tracking［J］.Acta Electronica Sinica,2009,37(4A):12-15.(in Chinese)
［7］CH Morimoto,MRM Mimica.Eye gaze tracking techniques for interactive applications［J］.Computer Vision and Image Understanding,2005,98(1):4-24.
［8］JJ Cerrolaza,A Villanueva,R Cabeza.Taxonomic study of polynomial regressions applied to the calibration of Video-Oculographic systems［A］.Proceedings of the 2008 Symposium on Eye Tracking Research & Applications［C］.New York,USA:ACM Press,2008.259-266.
［9］C Hennessey,P Lawrence.Improving the accuracy and reliability of remote system-calibration-free eye-gaze tracking［J］.IEEE Transaction.Biomedical Engineering,2009,56(7):1891-1900.
［10］黄莹，王志良，涂序彦，戚颖.一种可适应自然头动的视线追踪系统的研制及应用［J］.电子学报，2009,37(4):764-770.
Huang Ying,Wang Zhiliang,Tu Xuyan,Qi Ying.Development and application of a gaze-tracking system adapting to natural head-movements［J］.Acta Electronica Sinica,2009,37(4):764-770.(in Chinese)
［11］张鹏翼,王志良,郑思仪,张琼.使用立体视觉信息的视线追踪系统设计［J］.北京邮电大学报,2010,33(1):47-51.
ZHANG Pengyi,WANG Zhiliang,ZHENG Siyi,ZHANG Qiong.A design of eye gaze tracking system using stereovision information［J］.Journal of Beijing University of Posts and Telecommunications,2010,33(1):47-51.(in Chinese)
［12］Huabiao Qin,Weihong Yan.An adaptive calibration applying SLRA for gaze tracking［A］.Proceedings of the 2012 IET International Conference on Information Science and Control Engineering［C］.Shenzhen,China:IET Press,2012.119-122.
［13］P Viola,M Jones.Rapid object detection using a boosted cascade of simple features［A］.Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition［C］.US:IEEE Press,2001.511-518.
［14］RL Graham.An efficient algorithm for determining the convex hull of a finite planar set［J］.Information Processing Letters,1972,4(1):132-133.
［15］DH Yoo,JH Kim,BR Lee,MJ Chung.Non-contact eye gaze tracking system by mapping of corneal reflections［A］.Proceedings of 5th IEEE International Conference on Automatic Face and Gesture Recognition［C］.Washington,DC,USA:IEEE Press,2002.94-99.
［16］DH Yoo,MJ Chung.A novel non-intrusive eye gaze estimation using cross-ratio under large head motion［J］.Computer Vision and Image Understanding Special Issue on Eye Detection and Tracking,2005,98(1):25-51.
［17］FL Coutinho,CH Morimoto.Free head motion eye gaze tracking using a single camera and multiple light sources［A］.Proceedings of the XIX Brazilian Symposium on Computer Graphics and Image Processing［C］.Manaus:IEEE Press,2002.171-178.
［18］Dan Witzner Hansen,Javier San Agustin,Arantxa Villanueva.Homography normalization for robust gaze estimation in uncalibrated setups［A］.Proceedings of the 2010 Symposium on Eye-Tracking Research and Applications［C］.New York,USA:ACM Press,2010.13-20.

[1]	秦华标, 王信亮, 卢杰, 胡大正. 自然光下的新型动态注视点眼动向量[J]. 电子学报, 2016, 44(2): 420-425.
[2]	张闯;迟健男;张朝晖;王志良. 一种基于立体视觉的视线估计方法[J]. 电子学报, 2010, 38(5): 1008-1013.
[3]	程成, 杜菁菁, 蓝飞翔. 眼动交互的实时线性算法构造和实现[J]. 电子学报, 2009, 37(S1): 12-15.

一种可克服头动影响的视线跟踪系统

A Gaze Tracking System Overcoming Influences of Head Movements

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 3

编辑推荐

Metrics