一种基于动态显著性的人眼注视点移动计算模型

doi:10.3969/j.issn.0372-2112.2019.12.018

电子学报 ›› 2019, Vol. 47 ›› Issue (12): 2582-2589.DOI: 10.3969/j.issn.0372-2112.2019.12.018

一种基于动态显著性的人眼注视点移动计算模型

李鹏^1,2, 王延江¹

1. 中国石油大学(华东)信息与控制工程学院, 山东青岛 266580;
2. 中国石油大学(华东)计算机与通信工程学院, 山东青岛 266580

收稿日期:2018-08-13 修回日期:2019-06-11 出版日期:2019-12-25
- 通讯作者:
- 王延江
- 作者简介:
- 李鹏男,1975年出生,山东昌邑人,中国石油大学(华东)博士研究生,讲师.研究方向为计算机视觉、模式识别.E-mail:lipieu2002@163.com
- 基金资助:
- 国家自然科学基金资助项目 (No.61271407，No.61671480）; 山东省自然科学基金面上项目 (No.ZR2017MF069，No.ZR2018MF017）

A Computational Model of Fixation Movement Based on Dynamic Saliency

LI Peng^1,2, WANG Yan-jiang¹

1. College of Information and Control Engineering, China University of Petroleum(East China), Qingdao, Shandong 266580, China;
2. College of Computer and Communication Engineering, China University of Petroleum(East China), Qingdao, Shandong 266580, China

Received:2018-08-13 Revised:2019-06-11 Online:2019-12-25 Published:2019-12-25
- Corresponding author:
- WANG Yan-jiang
- Supported by:
- National Natural Science Foundation of China (No.61271407, No.61671480); General Program of Natural Science Foundation of Shandong Province, China (No.ZR2017MF069, No.ZR2018MF017)

摘要/Abstract

摘要： 人类对各种复杂视觉场景的感知通过注视点的不断移动来实现.但在计算机视觉中，如何准确模拟人眼注视点的移动而实现"看向哪儿"这一生物行为是一个难题.为此，本文基于动态显著性提出一种自由观察情形下的注视点移动计算模型.模型包括了全局跃迁和局部转移行为，前者是通过将眼动趋势、向心性和返回抑制性等规则进行融合来预测下一个注视点从而实现相对远距的注视点迁移；后者则是通过查找局部最大平均显著性点并将其作为转移的目的位置，二者通过预设准则进行切换.实验表明，所提模型能够更有效地模拟人眼注视点分布，具有良好的适用性.

关键词: 视觉显著性, 注视点, 视线, 跃迁, 转移

Abstract: The human eyes observe and perceive different external scenes by the continuous movement of fixations. It is of great difficulty to predict and model "where to look" of human eyes in computer vision research. To address this problem, a computational model including two parallel processes: global transition and local movement, is proposed based on visual dynamic saliency. The former predicts the long distance migrations of saccades in the scene by combining the eye movement bias,visual centrality and inhibition of return; the latter is used to determine the next destination by searching for the local largest average salient point. And these two processes can be switched through a certain judgment rule. Experimental results show that the proposed model can more effectively simulate the human eye gaze point distribution, resulting in better performance.

Key words: visual saliency, fixation point, gaze, transition, shift

中图分类号:

TP391

李鹏, 王延江. 一种基于动态显著性的人眼注视点移动计算模型[J]. 电子学报, 2019, 47(12): 2582-2589.

LI Peng, WANG Yan-jiang . A Computational Model of Fixation Movement Based on Dynamic Saliency[J]. Acta Electronica Sinica, 2019, 47(12): 2582-2589.

参考文献

[1] NAKASHIMA R,FANG Y,HATORI Y,et al.Saliency-based gaze prediction based on head direction.[J].Vision Research,2015,117(18):59-66.
[2] ITTI L,KOCH C,NIEBUR E,et al.A model of saliency-based visual attention for rapid scene analysis[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,1998,20(11):1254-1259.
[3] CHEN Z L,ZOU B J,GAO X,et al.Fusion visual attention and low-level features in images for region of interest extraction[J].Chinese Journal of Electronics,2013,22(2):287-290.
[4] ROTHKEGEL L,TRUKENBROD H A,SCHüTT H H,et al.Temporal evolution of the central fixation bias in scene viewing[J].Journal of Vision,2017,17(13):3,1-18.
[5] 王宜修,吴晓峰,王斌.基于中央凹图像显著性和扫视倾向的注视点转移预测模型[J].复旦大学学报(自然科学版),2016,55(4):431-441. WANG Yi-xiu,WU Xiao-feng,WANG Bin.Scanpath estimation based on foveal image saliency and saccadic bias[J].Journal of Fudan University(Natural Science),2016,55(4):431-441.(in Chinese)
[6] BOCCIGNONE G,FERRARO M.Gaze shift behavior on video as composite information foraging[J].Signal Processing Image Communication,2013,28(8):949-966.
[7] TATLER B W,HAYHOE M M,LAND M F,et al.Eye guidance in natural vision:reinterpreting salience[J].Journal of Vision,2011,11(5):5,1-23.
[8] MEUR O L,COUTROT A.Introducing context-dependent and spatially-variant viewing biases in saccadic models[J].Vision Research,2016,121(4):72-84.
[9] MEUR O L,COUTROT A,Liu Z,et al.Visual attention saccadic models learn to emulate gaze patterns from childhood to adulthood[J].IEEE Transactions on Image Processing,2017,26(10):4777-4789.
[10] SCHUTZ A C,BRAUN D I,Gegenfurtner K R,et al.Eye movements and perception:a selective review[J].Journal of Vision,2011,11(5):9,1-30.
[11] DORR M,MARTINETZ T,GEGENFURTNER K R,et al.Variability of eye movements when viewing dynamic natural scenes[J].Journal of Vision,2010,10(10):1-17.
[12] HOU X,ZHANG L.Saliency detection:a spectral residual approach[A].Proceedings of IEEE Conference on Computer Vision and Pattern Recognition[C].Washington,DC:IEEE,2007.1-8.
[13] SEBASTIAN T,ANITHA J.Hybrid hierarchical search motion estimation for video compression[A].Proceedings of IEEE International Conference on Advances in Electrical,Electronics,Information,Communication and Bio-Informatics[C].Washington,DC:IEEE,2016.88-92.
[14] BOCCIGNONE G,FERRARO M.Modelling eye-movement control via a constrained search approach[A].Proceedings of the European Workshop on Visual Information Processing[C].Washington,DC:IEEE,2011.235-240.
[15] VIG E,DORR M,COX D D,et al.Space-variant descriptor sampling for action recognition based on saliency and eye movements[A].Proceedings of the European Conference on Computer Vision[C].Berlin:Springer,2012.84-97.
[16] COUTROT A,GUYADER N.How saliency,faces,and sound influence gaze in dynamic social scenes[J].Journal of Vision,2014,14(8):5,1-17.
[17] BOTEV Z I,GROTOWSKI J F,KROESE D P,et al.Kernel density estimation via diffusion[J].Annals of Statistics,2010,38(5):2916-2957.
[18] MEUR O L,LIU Z.Saccadic model of eye movements for free-viewing condition[J].Vision Research,2015,116(17):152-164.
[19] 秦华标,王信亮,卢杰,等.自然光下的新型动态注视点眼动向量[J].电子学报,2016,44(2):420-425. QIN Hua-biao,WANG Xin-liang,LU jie,et al.A novel dynamic gaze vector in natural light[J].Acta Electronica Sinica,2016,44(2):420-425.(in Chinese)
[20] PETERS R J,IYER A,ITTI L,et al.Components of bottom-up gaze allocation in natural images[J].Vision Research,2005,45(19):2397-2416.
[21] TAVAKOLI H R,RAHTU E,HEIKKILA J,et al.Stochastic bottom-up fixation prediction and saccade generation[J].Image and Vision Computing,2013,31(9):686-693.
[22] NGO T,MANJUNATH B S.Saccade gaze prediction using a recurrent neural network[A].Proceedings of IEEE International Conference on Image Processing[C].Washington,DC:IEEE,2017.3435-3439.
[23] SEO H,MILANFAR P.Static and space-time visual saliency detection by self-resemblance[J].Journal of Vision,2009,9(12):15,1-27.
[24] RICHE N,MANCAS M,DUVINAGE M,et al.RARE2012:a multi-scale rarity-based saliency detection with its comparative statistical analysis[J].Signal Processing-Image Communication,2013,28(6):642-658.
[25] KIM W,KIM C.Spatiotemporal saliency detection using textural contrast and its applications[J].IEEE Transactions on Circuits and Systems for Video Technology,2014,24(4):646-659.

一种基于动态显著性的人眼注视点移动计算模型

A Computational Model of Fixation Movement Based on Dynamic Saliency

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	崔金鹏, 周洋, 殷海兵, 黄晓峰, 陆宇. 结合显著性的MVD视频整帧丢失错误隐藏[J]. 电子学报, 2022, 50(9): 2146-2154.
[2]	葛晨, 李胜, 张弛, 刘斯扬, 孙伟锋. 基于表面势的增强型p-GaN HEMT器件模型[J]. 电子学报, 2022, 50(5): 1227-1233.
[3]	罗会兰, 袁璞, 童康. 基于深度学习的显著性目标检测方法综述[J]. 电子学报, 2021, 49(7): 1417-1427.
[4]	陈帆, 屈凌峰, 原长琦, 和红杰. 基于有序等价划分的冗余空间转移图像加密安全性分析[J]. 电子学报, 2021, 49(4): 665-671.
[5]	张孟健, 龙道银, 王霄, 杨靖. 基于马尔科夫链的灰狼优化算法收敛性研究[J]. 电子学报, 2020, 48(8): 1587-1595.
[6]	钱晓亮, 白臻, 陈渊, 张鼎文, 史坤峰, 王芳, 吴青娥, 毋媛媛, 王慰. 协同视觉显著性检测方法综述[J]. 电子学报, 2019, 47(6): 1352-1365.
[7]	张亚坤, 周林, 陈辰, 贺玉成. 速率无损失的空间耦合LDPC码[J]. 电子学报, 2019, 47(12): 2590-2595.
[8]	孙梦博, 吕洪君, 张永强, 解光军. 量子元胞自动机全加器的性能分析与设计[J]. 电子学报, 2018, 46(7): 1774-1780.
[9]	丁鹏, 张叶, 贾平, 常旭岭, 刘让. 基于视觉显著性的海面舰船检测技术[J]. 电子学报, 2018, 46(1): 127-134.
[10]	许登荣, 程水英, 包守亮. 自适应转移概率交互式多模型跟踪算法[J]. 电子学报, 2017, 45(9): 2113-2120.
[11]	杜化鲲, 吕洪君, 黄程, 张永强, 解光军. 基于QCA的双边沿JK触发器的实现[J]. 电子学报, 2017, 45(8): 2044-2048.
[12]	欧阳城添, 江建慧, 王曦. 触发器可靠度计算的F-PTM方法[J]. 电子学报, 2016, 44(9): 2219-2226.
[13]	秦华标, 王信亮, 卢杰, 胡大正. 自然光下的新型动态注视点眼动向量[J]. 电子学报, 2016, 44(2): 420-425.
[14]	洪露, 龚成龙, 王经卓, 纪志成. 精英类克隆选择算法平均收敛速度估计[J]. 电子学报, 2015, 43(5): 916-921.
[15]	任冬淳, 张鹏, 王敏, 古楠楠. 一种基于标准化人眼图像的视线估计算法[J]. 电子学报, 2015, 43(3): 536-543.