视差式立体信息采集、感知几何模型及舒适观看区研究综述

doi:10.3969/j.issn.0372-2112.2013.03.024

摘要/Abstract

摘要： 近年来,立体影视产业蓬勃发展,基于视差的立体成像技术成为市场主流.但是,基于视差的立体成像技术存在深度畸变、视觉不舒适等问题.针对这些问题,本文研究了立体视频系统几何模型与舒适观看区.首先,总结并比较了立体采集系统的各种配置模式;接着讨论了平移式立体系统中拍摄空间到感知空间的映射关系,即畸变模型,并用形状、深度畸变因子解释了木偶剧效应和纸板效应;然后分析了舒适观看区,对其三种定义做了比较,并基于国际上普遍采用的1^o视差计算得出了舒适观看区域的几何范围;最后,本文将畸变模型和舒适观看区相关联,总结了立体图像拍摄应遵守的基本准则.

关键词: 立体系统, 畸变模型, 木偶剧效应, 纸板效应, 舒适观看区, 立体拍摄规则

Abstract: With the prosperity of stereoscopic industry,the disparity-based stereoscopic technology becomes more and more popular.But this technology may bring viewing discomfort and various image distortions such as depth plane curvature,depth non-linearity and so on.To analyze the origins,characteristics and relations of these perceptual issues,we investigated the stereoscopic distortion model and the comfortable viewing zone.This paper first summarized and compared three different configurations of the disparity-based stereoscopic video capturing systems,and focused on the parallel configuration system.The geometry of stereoscopic camera and display systems was presented.The mapping relationship,known as the distortion model,between the camera space and the viewing space was discussed in the parallel-shifting stereoscopic video systems.This distortion model is the basis of the stereoscopic information processing.The shape distortion factor and the depth factor were employed to explain the puppet theater effect and the cardboard effect.The comfortable viewing zone was considered to reduce the problem of visual discomfort and visual fatigue.Its three different representations were compared both qualitatively and quantitatively.At last,the distortion model and the comfortable viewing zone were combined to draw a conclusion of the stereoscopic shooting rules.

Key words: stereoscopic system, distortion model, puppet theater effect, cardboard effect, comfortable viewing zone, stereoscopic shooting rule

中图分类号:

TP391.41

侯春萍, 袁万鑫, 沈丽丽. 视差式立体信息采集、感知几何模型及舒适观看区研究综述[J]. 电子学报, DOI: 10.3969/j.issn.0372-2112.2013.03.024.

HOU Chun-ping, YUAN Wan-xin, SHEN Li-li. The Acquisition,Perception Geometric Model and the Comfortable Viewing Zone in Stereoscopic Video System:A Review[J]. Acta Electronica Sinica, DOI: 10.3969/j.issn.0372-2112.2013.03.024.

参考文献

[1] Andrew Woods.The Illusteated 3D HDTV List [EB/OL].http://www.3dmovielist.com/3dhdtvs.html,2012-12-10/2012-12-14.
[2] Ian P Howard,Brian J Rogers.Seeing in Depth:Basic Mechanics[M].New York:Oxford University Press,2008.1-10.
[3] Farley Norman,Hideko F Norman,Amy E Craft,et al.Stereopsis and aging[J].Vision Research,2008,48(23):2456-2465.
[4] Andrew Woods,Tom Docherty,Rolf Koch.Image distortions in stereoscopic video systems [A].Stereoscopic Displays and Applications [C].San Jose,USA:SPIE,1993.36-48.
[5] Wei Chen,Jérôme Fournier,Marcus Barkowsky,et al.New stereoscopic video shooting rule based on stereoscopic distortion parameters and comfortable viewing zone [A].Stereoscopic Displays and Applications XXII [C].San Francisco,USA:SPIE,2011.Vol.7863:Paper No.78631O.
[6] LIU Yebin,DAI Qionghai,XU Wenli.A wide base line multiple camera system for high performance 3D video and free viewpoint video[J].Chinese Journal of Electronics,2009,18(2):275-280.
[7] Park J,Kim H,Tai Y,et al.High quality depth map upsampling for 3D-TOF cameras [A].IEEE International Conference on Computer Vision [C].Barcelona,Spain:IEEE,2011.1623-1630.
[8] GONG Xun,WANG Guoyin,LI Xinxin,et al.A statistical two-step method for 3D face reconstruction from a single image[J].Chinese Journal of Electronics,2011,20(4):671-675.
[9] Jung-Young Son,Seokwon Yeom,Dong-Su Lee,et al.A stereoscopic camera model of focal plane detector array[J].Display Technology,2011,7(5):281-288.
[10] Seung W Lee,Nam Kim.A method for precise depth detection in stereoscopic display[J].Journal of the Optical Society of Korea,2006,10(1):37-41.
[11] Robert S Allison.The camera convergence problem revisited [A].Stereoscopic Displays and Virtual Reality Systems XI [C].San Jose,USA:SPIE,2004.167-178.
[12] Marc Lambooij,Wijnand IJsselsteijn,Marten Fortuin,et al.Visual discomfort and visual fatigue of stereoscopic sisplays:A review[J].Imaging Science and Technology,2009,53(3):1-14.
[13] Jung-Young Son,Yuri N Gruts,Kae-Dal Kwack,et al.Stereoscopic image distortion in radial camera and projector configurations[J].Journal of Optical Society of America,2007,24(3):643-650.
[14] Zahir Y.Alpaslan,Alexander A.Sawchuk.Multiple camera image acquisition models for multi-view 3D display interaction [A].IEEE 6th Workshop on Multimedia Signal Processing [C].Siena,Italy:IEEE,2004.256-262.
[15] Ki-Chul Kwon,Jae-Kwang Choi,Nam Kim.Automatic control of horizontal-moving stereoscopic camera by disparity compensation[J].Journal of the Optical Society of Korea,2002,6(4):150-155.
[16] Ki-Chul Kwon,Young-Tae Lim,Nam Kim,et al.Vergence control of binocular stereoscopic camera using disparity information [J].Journal of the Optical Society of Korea,2009,13(3):379-385.
[17] 朱效明,高稚允.双CCD立体视觉系统的理论研究[J].光学技术,2003,29(3):298-300. Zhu Xiaoming,Gao Zhiyun.Theoretic research on double-CCD stereoscopic system.Journal of Optical Technique,2003,29(3):298-300.(in Chinese)
[18] Wijnand A IJsselsteijn,Huib de Ridder,Joyce Vliegen.subjective evaluation of stereoscopic images:effects of camera parameters and display duration[J].IEEE Transactions on Circuits and Systems for Video Technology,2000,10(2):225-233.
[19] Lew B Stelmach,Wa J Tam,Filippo Speranza,et al.Improving the visual comfort of stereoscopic images [A].Stereoscopic Displays and Virtual Reality Systems X [C].Santa Clara,USA:SPIE,2003.269-282.
[20] Hoonjong Kang,Namho Hur,Seunghyun Lee,et al.Horizontal parallax distortion in toed-in camera with wide-angle lens for mobile device[J].Optical Communications,2008,281(6):1430-1437.
[21] Lydia M Meesters,Wijnand A IJsselsteijn,Pieter J Seunti?ns.A survey of perceptual evaluations and requirements of three dimensional TV[J].IEEE Transactions on Circuits and Systems for Video Technology,2004,14(3):381-391.
[22] J Daly,Robert T Held,David M Hoffman.Perceptual issues in stereoscopic signal processing[J].IEEE Transactions on Broadcasting,2011,57(2):347-361.
[23] Kenichiro Masaoka,Atsuo Hanazato,Masaki Emoto,et al.Spatial distortion prediction system for stereoscopic images[J].Electronic Imaging,2006,15(1):1-11.
[24] Hirokazu Yamanoue.The relation between size distortion and shooting conditions for stereoscopic images[J].Journal of the Society of Motion Picture and Television Engineers,1997,106(4):225-232.
[25] David L MacAdam.Stereoscopic perceptions of size shape distance and direction.Journal of the Society of Motion Picture and Television Engineers,1954,62(4):271-289.
[26] Hirokazu Yamanoue,Masaki Emoto,Yuji Nojiri.Stereoscopic HDTV[M].Japan:Springer,2012.11-44.
[27] Hirokazu Yamanoue,Makoto Okui,Fumio Okano.Geometrical analysis of puppet-theater and cardboard effects in stereoscopic HDTV images[J].IEEE Transactions on Circuits and Systems for Video Technology,2006,16(6):744-752.
[28] Mikko Kytø,Jussi Hakala.Geometric and subjective analysis of stereoscopic I3A cluster images [A].Stereoscopic Displays and Applications XXII [C].San Francisco,USA:SPIE,2011.Vol.7863:Paper No.786319.
[29] Hirokazu Yamanoue,Makoto Okui,Ichiro Yuyama.A study on the relationship between shooting conditions and cardboard effect of stereoscopic images[J].IEEE Transactions on Circuits and Systems for Video Technology,2000,10(3):411-416.
[30] Shimono Koichi,Wa T James,Vazquez Carlos,et al.Removing the cardboard effect in stereoscopic images using smoothed depth maps.Stereoscopic Displays and Applications XXI.San Jose,USA:SPIE,2010.
[31] Takashi Shibata,Joohwan Kim,David M Hoffman.The zone of comfort:Predicting visual discomfort with stereo displays[J].Journal of Vision,2011,11(8):1-29.
[32] David M Hoffman,Ahna R Girshick,Kurt Akeley,et al.Vergence-accommodation conflicts hinder visual performance and cause visual fatigue[J].Journal of Vision,2008,8(3):1-30.
[33] Liyuan Xing,Junyong You,Ebrahimi T,et al.Assessment of stereoscopic crosstalk perception[J].IEEE Transactions on Multimedias,2012,14(2):326-337.
[34] Janusz Konrad,Bertrand Lacotte,Eric Dubois.Cancellation of image crosstalk in time-sequential displays of stereoscopic video[J].IEEE Transactions on Image Processing,2000,9(5):897-908.
[35] Lili Wang,Teunissen K,Yan Tu,et al.Crosstalk evaluation in stereoscopic displays[J].Display Technology,2011,7(4):208-214.
[36] Tsirlin I,Wilcox L M,Allison R.The effect of crosstalk on the perceived depth from disparity and monocular occlusions[J].IEEE Transactions on Broadcasting,2011,57(2):445-453.
[37] Wei Chen,Jérôme Fournier,Marcus Barkowsky,et al.New requirements of subjective video quality assessment methodlogies for 3DTV [A].Fifth International Workshop on Video Processing and Quality Metrics for Consumer Electronics [C].Scottsdale,USA:VPQM,2010.1-6.
[38] Stephan Reichelt,Ralf Hussler,Gerald Fütterer,et al.Depth cues in human visual perception and their realization in 3D displays [A].Three-Dimensional Imaging,Visualization,and Display 2010 and Display Technologies and Applications for Defense,Security,and Avionics IV [C].Orlando,USA:SPIE,2010.Vol.7690:Paper No.76900B.
[39] Junle Wang,Marcus Barkowsky,Vincent Ricordel,et al.Quantifying how the combination of blur and disparity affects the perceived depth [A].Human Vision and Electronic Imaging XVI [C].San Francisco,USA:SPIE,2011.Vol.7865:No.78650K.
[40] Graham Jones,Delman Lee,Nicolas Holliman,et al.Controlling perceived depth in stereoscopic images [A].Stereoscopic Displays and Virtual Reality Systems VIII [C].Bellingham,WA:SPIE,2001.42-53.
[41] 赵堪兴,杨培增.眼科学(第七版)[M].北京:人民卫生出版社,2008.226-229.
[42] Siegmund Pastoor.Human factors of 3DTV:An overview of current research at Heinrich-Hertz-Institute Berlin [A].IEE Colloquium on Stereoscopic Television [C].London:IEEE,1992.1-4.
[43] Matthias Wøpking.Viewing comfort with stereoscopic pictures:An experimental study on the subjective effects of dispairty magnitude and depth of focus[J].Journal of the Society for Information Display,1995,3(3):101-103.
[44] Siegmund Pastoor.Human factors of 3D imaging:Results of recent research at Heinrich-Hertz-Institute Berlin [A].2nd International Display Workshops [C].Hamamatsu,Japan:IDW'95 Committe,1995.69-72.
[45] Filippo Speranza,Wa J Tam,Ron Renaud,et al.Effect of disparity and motion on visual comfort of stereoscopic images [A].Stereoscopic Displays and Virtual Reality Systems XIII [C].San Jose,USA:SPIE,2006.Vol.6055:Paper No.60550B.
[46] Recommendation ITU-R BT.1438-2000,Subjective Assessment of Stereoscope Television Pictures[S].
[47] Sumio Yanoa,Masaki Emotoa,Tetsuo Mitsuhashi.Two factors in visual fatigue caused by stereoscopic HDTV images[J].Journal of Displays,2004,25(4):141-150.
[48] Nick Holliman.Mapping perceived depth to regions of interest in stereoscopic images [A].Stereoscopic Displays and Virtual Reality Systems XI [C].San Jose,USA:SPIE,2004.117-128.