3DQoE评价方法及其模型研究进展综述

doi:10.3969/j.issn.0372-2112.2015.03.023

电子学报 ›› 2015, Vol. 43 ›› Issue (3): 568-576.DOI: 10.3969/j.issn.0372-2112.2015.03.023

3DQoE评价方法及其模型研究进展综述

刘延伟¹, 刘金霞², 慈松¹, 要瑞霄¹, 赵平华¹, 王遵义²

1. 中国科学院声学研究所高性能网络实验室, 北京 100190;
2. 浙江万里学院, 浙江宁波 315100

收稿日期:2014-05-15 修回日期:2014-08-03 出版日期:2015-03-25
- 通讯作者:
- 刘金霞
- 作者简介:
- 刘延伟 男,1976年出生于黑龙江省,博士,中国科学院声学研究所助理研究员,主要研究方向为视频处理与通信、无线通信. E-mail:liuyw@hpnl.ac.cn
- 基金资助:
- 国家自然科学基金 (No.61102077); 浙江省自然科学基金 (No.LY13F010012); 浙江省公益项目 (No.2014C31072); 宁波市科技创新团 (No.2012B82006)

Overview of 3DQoE Assessment and Modeling

LIU Yan-wei¹, LIU Jin-xia², CI Song¹, YAO Rui-xiao¹, ZHAO Ping-hua¹, WANG Zun-yi²

1. High Performance Network Lab, Institute of Acoustics, Chinese Academy of Sciences, Beijing100190, China;
2. Zhejiang Wanli University, Ningbo, Zhejiang315100, China

Received:2014-05-15 Revised:2014-08-03 Online:2015-03-25 Published:2015-03-25

摘要/Abstract

摘要：

随着3D视频技术的逐步发展,3D视频网络服务的用户体验质量(3DQoE)评价逐步成为学术界和工业界都极为关注的热点问题之一.本文通过分析端到端的3DQoE影响因素,总结基于3D视频与图像质量的3DQoE评价方法,综述3DQoE模型的研究进展.通过3DQoE评价与模型研究现状的分析,本文给出了目前3DQoE评价与模型研究过程中存在的精确性,可靠性以及通用性问题,并指出针对大规模网络服务的3DQoE建模是未来可能的研究方向.

关键词: 3DQoE模型, 3D视频/图像质量评价, 3D视频服务

Abstract:

Due to the rapid advancements in 3D video technologies, 3D quality of experience (3DQoE) assessment for 3D video networking service attracts the researchers' attention in both academic and industry world.The contribution factors of 3DQoE in the end-to-end processing chain are analyzed.The 3D video/image quality based 3DDoE evaluation methodologies and the current research progresses in 3DQoE modeling are reviewed.Based on the analysis of the current research status of 3DQoE assessment and modeling, we point out the inadequacies in accuracy, reliability and universality of the current 3DQoE assessment and modeling research, and indicate that 3DQoE model towards massive networking service is possibly the future research direction.

Key words: 3D quality of experience model, 3D video/image quality assessment, 3D video service

中图分类号:

TP919.72

刘延伟, 刘金霞, 慈松, 要瑞霄, 赵平华, 王遵义. 3DQoE评价方法及其模型研究进展综述[J]. 电子学报, 2015, 43(3): 568-576.

LIU Yan-wei, LIU Jin-xia, CI Song, YAO Rui-xiao, ZHAO Ping-hua, WANG Zun-yi. Overview of 3DQoE Assessment and Modeling[J]. Acta Electronica Sinica, 2015, 43(3): 568-576.

参考文献

[1] ITU-T Rec.G.100/P.10 Amendment 1-2007.New Appendix I -definition of Quality of Experience (QoE)[S].
[2] 林闯, 胡杰, 孔祥震.用户体验质量的模型与评价方法综述[J].计算机学报, 2012, 35(1):1-15. Lin Chuang, Hu Jie, Kong Xiang Zhen, Survey on models and evaluation of quality of experience[J].Chinese Journal of Computers, 2012, 35(1):1-15.(in Chinese)
[3] Hewage C, Martini M.Quality of experience for 3D video streaming[J].IEEE Communications Magazine, 2013, 51(5):101-107.
[4] VQEG.Establishing a Ground Truth for Quality of Experience in 3D for Assessment Methodologies in 3D Video Quality Assessment[EB/OL].http://www.its.bldrdoc.gov/vqeg/projects/3dtv/3dtv.aspx, 2014-5-2.
[5] Chen W, Fournier J, Barkowsky M, Callet P.Quality of experience model for 3DTV[A].SPIE Stereoscopic Displays and Applications XXIII[C].USA:SPIE, 2012.1-9.
[6] Xing L, You J, Ebrahimi T, Perkis A.An objective metric for assessing quality of experience on stereoscopic images[A].International Workshop on Multimedia Signal Processing[C].USA:IEEE, 2010.373-378.
[7] Chen W, Fournier J, Barkowsky M, Le Callet P.Exploration of quality of experience of stereoscopic images:binocular depth[A].Sixth International Workshop on Video Processing and Quality Metrics for Consumer Electronics-VPQM[C].USA:IEEE, 2012.1-6.
[8] Liu Y, Ci S, Tang H, Ye Y, Liu J.QoE-oriented 3D Video transcoding for mobile streaming[J].ACM Transactions on Multimedia Computing, Communications and Applications, 2012, 8(3s):article 42.
[9] Liu Y, Ci S, Tang H, Ye Y.Application-adapted mobile 3D video coding and streaming-a survey[J].3D Research Journal, 2012, 3(1):article 3.
[10] Smolic A, Kauff P, Knorr S, Hornung A, Kunter M, Muller M, Lang M.Three-dimensional video postproduction and processing[J].Proceeding of IEEE, 2011, 99(4):607-625.
[11] Tam W, Stelmach L, Corriveau P.Psychovisual aspects of viewing stereoscopic video sequences[A].Proceeding of SPIE[C].USA:IEEE, 1998.226-235.
[12] 喻莉, 张军涛, 邓慧萍, 等.SSIM度量虚拟视点绘制失真的深度图帧内编码[J].中国图象图形学报, 2012, 17(11):1353-1358. Yu L, Zhang J, Deng H, et al.Virtual view rendering distortion using the structural similarity index as quality metric for depth map intra coding[J].Journal of Image and Graphics 2012, 17(11):1353-1358.(in Chinese)
[13] Liu Yan-wei, Huang Qing-ming, Ma Si-wei, et al.Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model[J].Signal Processing:Image Communication, 2009, 24(8):666-681.
[14] Urvoy M, Barkowsky M, Le Callet P.How visual fatigue and discomfort impact 3D-TV quality of experience:a comprehensive review of technological, psychophysical, and psychological factors[J].Annales des Télécommunications, 2013, 68(11-12):641-655.
[15] ITU-R Recommendation BT.500-11.Methodology for the Subjective Assessment of the Quality of Television Pictures[EB/OL].http://www.dii.unisi.it/～menegaz/DoctoralSchool2004/papers/ITUR_ BT.500-11.pdf, 2002.
[16] Wang Z, Bovik A, Sheikh H, Simoncelli E.Image quality assessment:From error visibility to structural similarity[J].IEEE Transactions on Image Processing, 2004, 13(4):600-612.
[17] Branden Lambrecht C.Color moving pictures quality metric[A].Proceedings of the IEEE International Conference on Image Processing[C].USA:IEEE, 1996.885-888.
[18] 王新岱, 杨付正, 常义林.基于数字水印的无参考视频质量评估方法[J].西安电子科技大学学报, 2004, 31(2):229-233. Wang X, Yang F, Chang Y.A no-reference video quality assessment method based on digital watermark[J].Journal of Xidian University, 2004, 31(2):229-233.(in Chinese)
[19] Naccari M, Tagliasacchi M, Tubaro S.No-reference video quality monitoring for H.264/AVC coded video[J].IEEE Transactions on Multimedia, 2009, 11(5):932-946.
[20] Quan H, Le Callet P, Barkowsky M.Video quality assessment:From 2D to 3D-challenges and future trends[A].Proceeding of IEEE International Conference on Image Processing[C].USA:IEEE, 2010.4025-4028.
[21] Hewage C, Worrall S, Dogan S, Kondoz A.Quality evaluation of colour plus depth map based stereoscopic video[J].IEEE Journal of Selected Topics in Signal Processing:Visual Media Quality Assessment, 2009, 3(2):304-318.
[22] Tam W, Speranza F, Yano S, Shimono K, Ono H.Stereoscopic 3D-TV:visual comfort[J].IEEE Transactions on Broadcasting, 2011, 57( 2):335-346.
[23] You J, Xing L, Perkis A, Wang X.Perceptual quality assessment for stereoscopic images based on 2D image quality metrics and disparity analysis[A].Proceeding of International Workshop Video Processing and Quality Metrics for Consumer Electronics[C].USA:IEEE, 2010.1-6.
[24] Hewage C, Worrall S, Dogan S, Kondoz A, Prediction of stereoscopic video quality using objective quality models of 2-D video[J].Electron Lett, 2008, 44(16):963-965.
[25] Bensalma R, Larabi M.A perceptual metric for stereoscopic image quality assessment based on the binocular energy[J].Multidimensional System Signal Processing, 2012, 24( 2):281-316.
[26] 蒋刚毅, 黄大江, 王旭, 等.图像质量评价方法研究进展[J].电子与信息学报, 2010, 32(1):219-226. Jiang G Y, Huang D J, Wang X, et al.Overview on image quality assessment methods[J].Journal of Electronics & Information Technology, 2010, 32(1):219-226.(in Chinese)
[27] Chen M, Su D, Kwon C, Cormack L, Bovik A.Full-reference quality assessment of stereopairs accounting for rivalry[A].Forty-sixth Annual Asilomar Conference on Signals, Systems, and Computers[C].USA:IEEE, 2012.1-5.
[28] Field D J.Relations between the statistics of natural images and the response properties of cortical-cells[J].Journal of the Optical Society of America, 1987, 4(12):2379-2394.
[29] Hewage C, Martini M.Reduced-reference quality metric for 3D depth map transmission[J].Proceeding of Capture, Transmission and Display 3D Video[C].Finland:IEEE, 2010.1-4.
[30] Hewage C, Martini M.Edge-based reduced-reference quality metric for 3-D video compression and transmission[J].IEEE Journal of Selected Topics in Signal Processing, 2012, 6(5):471-482.
[31] Akhter R, Baltes J, Parvez Sazzad Z, Horita Y.No reference stereoscopic image quality assessment[A].Proceeding of SPIE[C].USA:SPIE, 2010.75240T.
[32] Solh M, AlRegib G.A no-reference quality measure for dibr-based 3D videos[A].Proceeding of International Conference on Multimedia and Expo[C].USA:IEEE, 2011.1-6.
[33] Chen M, Cormack L, Bovik A.No-reference quality assessment of natural stereopairs[J].IEEE Transactions on Image Processing, 2013, 22(9):3379-3391.
[34] Moorthy A, Bovik A.Blind image quality assessment:From natural scene statistics to perceptual quality[J].IEEE Transactions on Image Processing, 2011, 20(12):3350-3364.
[35] EPFL-MMSPG.3D Video Quality Assessment[EB/OL].http://mmspg.epfl.ch/3dvqa, 2013-1-2/ 2014-7-30.
[36] MOBILE 3DTV Project.Stereo-video Database[EB/OL].http://sp.cs.tut.fi/mobile3dtv/stereo-video/, 2010-1-2/ 2014-7-30.
[37] Lebreton P, Raake A, Barkowsky M, et al.Perceptual preference of S3D over 2D for HDTV in dependence of video quality and depth[A].IEEE 11th IVMSP Workshop[C].USA:IEEE, 2013.1-4.
[38] Kim D, Sohn K.Visual fatigue prediction for stereoscopic image[J].IEEE Transactions on Circuits System and Video Technology, 2011, 21(2):231-236.
[39] Wang K, et al.Perceived 3D TV transmission quality assessment:multilaboratory results using absolute category rating on quality of experience scale[J].IEEE Transactions on Broadcasting, 2012, 58(4):544-556.
[40] Xing L, You J, Ebrahimi T, Perkis A.Assessment of stereoscopic crosstalk perception[J].IEEE Transactions on Multimedia, 2012, 14(2):326-337.
[41] Xing L.Towards Reliable Stereoscopic 3D Quality Evaluation-Subjective Assessment and Objective Metrics[D].Norway:Norwegian University of Science of Technology, 2013.
[42] Mohamed S, Rubino G.A study of real-time packet video quality using random neural networks[J].IEEE Transactions on Circuits and Systems for Video Technology, 2002, 12(12):1071-1083.
[43] Menkovski V, Exarchakos G, Liotta A.Machine learning approach for quality of experience aware networks[A].Proceeding of 2nd International Conference on Intelligent Networking and Collaborative Systems[C].USA:IEEE, 2010.461-466.
[44] Goldmann L, Ebrahimi T.Towards reliable and reproducible 3D video quality assessment[A].International Conference on Three-Dimensional Imaging, Visualization, and Display 2011[C].USA:SPIE, 2011.1-6.
[45] Kulik I, András K, Anh T, Bokor L.Analysis of the relationship between quality of experience and service attributes for 3D future Internet multimedia[A].4th IEEE International Conference on Cognitive Info Communications[C].USA:IEEE, 2013.641-646.

3DQoE评价方法及其模型研究进展综述

Overview of 3DQoE Assessment and Modeling

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 1

编辑推荐

Metrics