全参考图像质量评价回顾与展望

高敏娟; 党宏社; 魏立力; 刘国军; 张选德

doi:10.12263/DZXB.20200780

您当前的位置：

首页 >

文章列表页 >

全参考图像质量评价回顾与展望

综述评论 | 更新时间：2025-12-08

- 全参考图像质量评价回顾与展望
- Review and Prospect of Full Reference Image Quality Assessment
- 电子学报 2021年49卷第11期页码：2261-2272
- 作者机构：
  
  1.陕西科技大学电气与控制工程学院，陕西西安 710021
  2.宁夏大学数学统计学院，宁夏银川 750021
  3.陕西科技大学电子信息与人工智能学院，陕西西安 710021
- 作者简介：
  
  [ "高敏娟女，1984年生，山西忻州人.博士研究生，主要研究方向为图像处理、图像质量评价.E-mail:gaominjuan1984@163.com" ]
  [ "党宏社男，1962年生，陕西武功人.教授、博士生导师，主要研究方向为工业过程与优化、计算机控制和图像处理. E-mail:danghs@sust.edu.cn" ]
  [ "魏立力男，1965年生，甘肃天水人.教授，主要研究方向为应用统计与数据分析. E-mail:liliwei@nxu.edu.cn" ]
  [ "刘国军男，1978年生，宁夏吴忠人.教授，主要研究方向为小波分析、偏微分方程图像处理和图像质量评价. E-mail:liugj@nxu.edu.cn" ]
  [ "张选德（通讯作者）男，1979年生，宁夏固原人.教授、博士生导师，主要研究方向为图像恢复、图像质量评价、稀疏表示和低秩逼近理论. E-mail:zhangxuande@sust.edu.cn" ]
- 基金信息：
  
  国家自然科学基金(61871260);陕西省自然科学基金(2020JM-509)
- DOI：10.12263/DZXB.20200780
  中图分类号： TP391;
- 收稿：2020-07-27，
  
  修回：2021-03-09，
  
  纸质出版：2021-11-25
- 稿件说明：
移动端阅览
高敏娟,党宏社,魏立力等.全参考图像质量评价回顾与展望[J].电子学报,2021,49(11):2261-2272.

GAO Min-juan,DANG Hong-she,WEI Li-li,et al.Review and Prospect of Full Reference Image Quality Assessment[J].ACTA ELECTRONICA SINICA,2021,49(11):2261-2272.
高敏娟,党宏社,魏立力等.全参考图像质量评价回顾与展望[J].电子学报,2021,49(11):2261-2272. DOI： 10.12263/DZXB.20200780.

GAO Min-juan,DANG Hong-she,WEI Li-li,et al.Review and Prospect of Full Reference Image Quality Assessment[J].ACTA ELECTRONICA SINICA,2021,49(11):2261-2272. DOI： 10.12263/DZXB.20200780.

摘要

全参考图像质量评价(Full Reference Image Quality Assessment

FR-IQA)是IQA领域广为研究的类型之一.本文回顾了FR-IQA的发展历程，对FR-IQA应用现状和通用FR-IQA问题的构建进行综述，以及对FR-IQA算法进行总结和梳理.并在此基础上，重点分析了现有研究中存在的问题，包括问题构建的合理性、建模的全面性问题、知识驱动与数据驱动结合的问题等.基于对主观评价过程的深入分析，结合现有研究存在的问题，探讨了主观评分采用模糊建模和知识与数据联合驱动构建算法两个可能的研究方向，以期对后续的研究者提供参考.

Abstract

Full reference image quality assessment (FR-IQA) is one of the types widely studied in the field of IQA. This paper reviews the development of FR-IQA

summarizes the application status of FR-IQA and the construction of general FR-IQA problems

and summarizes and combs FR-IQA algorithms. And on this basis

it focuses on the problems existing in the existing research

including the rationality of the problem construction

the comprehensive problem of modeling

and the problem of the combination of knowledge-driven and data-driven. Finally

based on the in-depth analysis of the subjective evaluation process and the existing problems in the existing research

the two possible research directions of subjective scoring using fuzzy modeling and knowledge-data-driven construction algorithm are discussed

in order to provide reference for subsequent researchers.

关键词

Keywords

references

Chandler D M . Seven challenges in image quality assessment: Past, present, and future research [J]. ISRN Signal Processing , 2013 , 2013 : 1 － 53 .

Mohammadi P , Ebrahimi-Moghadam A , Shirani S . Subjective and objective quality assessment of image: A survey [J]. Majlesi Journal of Electrical Engineering , 2014 , 9 ( 1 ): 419 － 423 .

Mannos J , Sakrison D . The effects of a visual fidelity criterion of the encoding of images [J]. IEEE Transactions on Information Theory , 1974 , 20 ( 4 ): 525 － 536 .

Buades A , Coll B , Morel J M . A review of image denoising algorithms, with a new one [J]. Multiscale Modeling & Simulation , 2005 , 4 ( 2 ): 490 － 530 .

李亮亮 . 基于非下采样剪切波变换的图像增强算法研究 [D]. 长春 : 吉林大学 , 2019 .

Li L L . The research of image enhancement algorithm based on nonsubsampled shearlet transform [D]. Changchun, China : Jilin University , 2019 . (in Chinese)

Wang Z , Bovik A C , Sheikh H R , et al . Image quality assessment: From error visibility to structural similarity [J]. IEEE Transactions on Image Processing , 2004 , 13 ( 4 ): 600 － 612 .

沈瑜 , 陈小朋 , 刘成 , 等 . 基于混合模型驱动的红外与可见光图像融合 [J]. 控制与决策 , 2021 , 36 ( 9 ): 2143 － 2151 .

Shen Y , Chen X P , Liu C , et al . Infrared and visible image fusion based on hybrid model driving [J]. Control and Decision , 2021 , 36 ( 9 ): 2143 － 2151 . (in Chinese)

Ding K Y , Ma K D , Wang S Q , et al . Comparison of full-reference image quality models for optimization of image processing systems [J]. International Journal of Computer Vision , 2021 , 129 ( 4 ): 1258 － 1281 .

Zhao H , Gallo O , Frosio I , et al . Loss functions for image restoration with neural networks [J]. IEEE Transactions on Computational Imaging , 2017 , 3 ( 1 ): 47 － 57 .

Wang Z , Simoncelli E P , Bovik A C . Multiscale structural similarity for image quality assessment [A]. The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers[C]. Pacific Grove , CA, USA : IEEE , 2003 . 1398 － 1402 .

Laparra V , Ballé J , Berardino A , et al . Perceptual image quality assessment using a normalized Laplacian pyramid [J]. Electronic Imaging , 2016 , 2016( 16 ): 1 － 6 .

Laparra V , Berardino A , Ballé J , et al . Perceptually optimized image rendering [J]. Journal of the Optical Society of America A: Optics , Image Science, and Vision, 2017 , 34 ( 9 ): 1511 － 1525 .

Ma J J , Nakarmi U , Kin C Y S , et al . Diagnostic image quality assessment and classification in medical imaging: Opportunities and challenges [A]. 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI) [C]. Iowa City, IA, USA : IEEE , 2020 . 337 － 340 .

郭从洲 , 李可 , 李贺 , 等 . 遥感图像质量等级分类的深度卷积神经网络方法 [J/OL]. 武汉大学学报(信息科学版) , 2020 , DOI: 10.13203/j.whugis20200292 http://dx.doi.org/10.13203/j.whugis20200292 .

GUO C Z , LI K , LI H , et al . A deep convolution -al neural network method for remote sensing image quality classification [J/OL]. Geomatics and Information Sinence of Wuhan University , 2020 , DOI: 10.13203/j.whugis20200292. http://dx.doi.org/10.13203/j.whugis20200292. (in Chinese)

李毅红 , 韩焱 , 潘晋孝 , 等 . 基于递变能量线性约束的X射线图像质量评价方法 [J]. 电子学报 , 2017 , 45 ( 3 ): 669 － 673 .

Li Y H , Han Y , Pan J X , et al . X-ray image quality evaluation based on linear constraint with variable energy [J]. Acta Electronica Sinica , 2017 , 45 ( 3 ): 669 － 673 . (in Chinese)

Sheikh H R , Wang Z , Bovik A C , et al . Image and video quality assessment research at LIVE [EB/OL]. http://live.ece.utexas.edu/research/quality http://live.ece.utexas.edu/research/quality , 2020 .

Larson E C , Chandler D M . Categorical subjective image quality database [EB/OL]. http://vision.okstate.edu/csiq http://vision.okstate.edu/csiq , 2020 .

Ponomarenko N , Egiazarian K . Tampere image database TID2008 [EB/OL]. http://www.ponomarenko.info/tid2008 http://www.ponomarenko.info/tid2008 , 2020 .

Ponomarenko N , Jin L N , Ieremeiev O , et al . Image database TID2013: Peculiarities, results and perspectives [J]. Signal Processing: Image Communication , 2015 , 30 : 57 － 77 .

Ninassi A , Callet P L , Autrusseau F . Subjective quality assessment IVC database 2005 [EB/OL]. http://www2.irccyn.ecnantes.fr/ivcdb http://www2.irccyn.ecnantes.fr/ivcdb , 2020 .

Chandler D M , Hemami S S . A 57 Database 2007 [EB/OL]. http://foulard.ece.cornell.edu/dmc27/vsnr/vsnr.html.A57 http://foulard.ece.cornell.edu/dmc27/vsnr/vsnr.html.A57 , 2020 .

Ma K D , Duanmu Z F , Wu Q B , et al . Waterloo exploration database: New challenges for image quality assessment models [J]. IEEE Transactions on Image Processing , 2017 , 26 ( 2 ): 1004 － 1016 .

Zhang R , Isola P , Efros A A , et al . The unreasonable effectiveness of deep features as a perceptual metric [A]. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition [C]. Salt Lake City, UT, USA : IEEE , 2018 . 586 － 595 .

Lin H H , Hosu V , Saupe D . KADID-10k: A large-scale artificially distorted IQA database [A]. 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX) [C]. Berlin, Germany : IEEE , 2019 . 1 － 3 .

Wang Z , Simoncelli E P . Maximum differentiation (MAD) competition: A methodology for comparing computational models of perceptual quantities [J]. Journal of Vision , 2008 , 8 ( 12 ): 1 － 8 .

Ma K D , Duanmu Z F , Wang Z , et al . Group maximum differentiation competition: Model comparison with few samples [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2020 , 42 ( 4 ): 851 － 864 .

Sheikh H R , Bovik A C , de Veciana G . An information fidelity criterion for image quality assessment using natural scene statistics [J]. IEEE Transactions on Image Processing , 2005 , 14 ( 12 ): 2117 － 2128 .

Sheikh H R , Bovik A C . Image information and visual quality [J]. IEEE Transactions on Image Processing , 2006 , 15 ( 2 ): 430 － 444 .

Sheikh H R , Sabir M F , Bovik A C . A statistical evaluation of recent full reference image quality assessment algorithms [J]. IEEE Transactions on Image Processing , 2006 , 15 ( 11 ): 3440 － 3451 .

Shnayderman A , Gusev A , Eskicioglu A M . An SVD-based grayscale image quality measure for local and global assessment [J]. IEEE Transactions on Image Processing , 2006 , 15 ( 2 ): 422 － 429 .

Wang Z , Shang X L . Spatial pooling strategies for perceptual image quality assessment [A]. 2006 International Conference on Image Processing [C]. Atlanta, GA, USA : IEEE , 2006 . 2945 － 2948 .

Chen G H , Yang C L , Xie S L . Gradient-based structural similarity for image quality assessment [A]. 2006 International Conference on Image Processing [C]. Atlanta, GA, USA : IEEE , 2006 . 2929 － 2932 .

Chandler D M , Hemami S S . VSNR: A wavelet-based visual signal-to-noise ratio for natural images [J]. IEEE Transactions on Image Processing , 2007 , 16 ( 9 ): 2284 － 2298 .

Sampat M P , Wang Z , Gupta S , et al . Complex wavelet structural similarity: A new image similarity index [J]. IEEE Transactions on Image Processing , 2009 , 18 ( 11 ): 2385 － 2401 .

Moorthy A K , Bovik A C . Visual importance pooling for image quality assessment [J]. IEEE Journal of Selected Topics in Signal Processing , 2009 , 3 ( 2 ): 193 － 201 .

Larson E C , Chandler D M . Most apparent distortion: Full-reference image quality assessment and the role of strategy [J]. Journal of Electronic Imaging , 2010 , 19 ( 1 ): 011006 .

Zhang L , Zhang L , Mou X Q . RFSIM: A feature based image quality assessment metric using Riesz transforms [A]. 2010 IEEE International Conference on Image Processing [C]. Hong Kong, China : IEEE , 2010 . 321 － 324 .

Wang Z , Li Q . Information content weighting for perceptual image quality assessment [J]. IEEE Transactions on Image Processing , 2011 , 20 ( 5 ): 1185 － 1198 .

Zhang L , Zhang L , Mou X Q , et al . FSIM: A feature similarity index for image quality assessment [J]. IEEE Transactions on Image Processing , 2011 , 20 ( 8 ): 2378 － 2386 .

Liu A M , Lin W S , Narwaria M . Image quality assessment based on gradient similarity [J]. IEEE Transactions on Image Processing , 2012 , 21 ( 4 ): 1500 － 1512 .

Zhu J Y , Wang N C . Image quality assessment by visual gradient similarity [J]. IEEE Transactions on Image Processing , 2012 , 21 ( 3 ): 919 － 933 .

Capodiferro L , Jacovitti G , Di Claudio E D . Two-dimensional approach to full-reference image quality assessment based on positional structural information [J]. IEEE Transactions on Image Processing , 2012 , 21 ( 2 ): 505 － 516 .

Xue W F , Zhang L , Mou X Q , et al . Gradient magnitude similarity deviation: A highly efficient perceptual image quality index [J]. IEEE Transactions on Image Processing , 2014 , 23 ( 2 ): 684 － 695 .

Zhang X D , Feng X C , Wang W W , et al . Edge strength similarity for image quality assessment [J]. IEEE Signal Processing Letters , 2013 , 20 ( 4 ): 319 － 322 .

Wu J J , Lin W S , Shi G M , et al . Perceptual quality metric with internal generative mechanism [J]. IEEE Transactions on Image Processing , 2013 , 22 ( 1 ): 43 － 54 .

Chang H W , Yang H , Gan Y , et al . Sparse feature fidelity for perceptual image quality assessment [J]. IEEE Transactions on Image Processing , 2013 , 22 ( 10 ): 4007 － 4018 .

Zhang L , Shen Y , Li H Y . VSI: A visual saliency-induced index for perceptual image quality assessment [J]. IEEE Transactions on Image Processing , 2014 , 23 ( 10 ): 4270 － 4281 .

Preiss J , Fernandes F , Urban P . Color-image quality assessment: From prediction to optimization [J]. IEEE Transactions on Image Processing , 2014 , 23 ( 3 ): 1366 － 1378 .

Pei S C , Chen L H . Image quality assessment using human visual DOG model fused with random forest [J]. IEEE Transactions on Image Processing , 2015 , 24 ( 11 ): 3282 － 3292 .

Lee D , Plataniotis K N . Towards a full-reference quality assessment for color images using directional statistics [J]. IEEE Transactions on Image Processing , 2015 , 24 ( 11 ): 3950 － 3965 .

Nafchi H Z , Shahkolaei A , Hedjam R , et al . Mean deviation similarity index: Efficient and reliable full-reference image quality evaluator [J]. IEEE Access , 2016 , 4 : 5579 － 5590 .

Bae S H , Kim M . A novel image quality assessment with globally and locally consilient visual quality perception [J]. IEEE Transactions on Image Processing , 2016 , 25 ( 5 ): 2392 － 2406 .

Reisenhofer R , Bosse S , Kutyniok G , et al . A Haar wavelet-based perceptual similarity index for image quality assessment [J]. Signal Processing: Image Communication , 2018 , 61 : 33 － 43 .

Li L D , Cai H , Zhang Y B , et al . Sparse representation-based image quality index with adaptive sub-dictionaries [J]. IEEE Transactions on Image Processing , 2016 , 25 ( 8 ): 3775 － 3786 .

Ding L , Huang H , Zang Y . Image quality assessment using directional anisotropy structure measurement [J]. IEEE Transactions on Image Processing , 2017 , 26 ( 4 ): 1799 － 1809 .

Gu K , Li L D , Lu H , et al . A fast reliable image quality predictor by fusing micro- and macro-structures [J]. IEEE Transactions on Industrial Electronics , 2017 , 64 ( 5 ): 3903 － 3912 .

Sun W , Liao Q M , Xue J H , et al . SPSIM: A superpixel-based similarity index for full-reference image quality assessment [J]. IEEE Transactions on Image Processing , 2018 , 27 ( 9 ): 4232 － 4244 .

Ahar A , Barri A , Schelkens P . From sparse coding significance to perceptual quality: A new approach for image quality assessment [J]. IEEE Transactions on Image Processing , 2018 , 27 ( 2 ): 879 － 893 .

Di Claudio E D , Jacovitti G . A detail-based method for linear full reference image quality prediction [J]. IEEE Transactions on Image Processing , 2018 , 27 ( 1 ): 179 － 193 .

Jia H Z , Zhang L , Wang T H . Contrast and visual saliency similarity-induced index for assessing image quality [J]. IEEE Access , 2018 , 6 : 65885 － 65893 .

Temel D , AlRegib G . Perceptual image quality assessment through spectral analysis of error representations [J]. Signal Processing: Image Communication , 2019 , 70 : 37 － 46 .

Kim W , Nguyen A D , Lee S , et al . Dynamic receptive field generation for full-reference image quality assessment [J]. IEEE Transactions on Image Processing , 2020 , 29 : 4219 － 4231 .

Ling W Y , Hu Y . Machine learning to design full-reference image quality assessment algorithm [J]. TELKOMNIKA Indonesian Journal of Electrical Engineering , 2013 , 11 ( 6 ): 3439 － 3444 .

Narwaria M , Lin W S . SVD-based quality metric for image and video using machine learning [J]. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) , 2012 , 42 ( 2 ): 347 － 364 .

Liu T J , Lin W S , Kuo C C J . Image quality assessment using multi-method fusion [J]. IEEE Transactions on Image Processing , 2013 , 22 ( 5 ): 1793 － 1807 .

Gastaldo P , Zunino R , Redi J . Supporting visual quality assessment with machine learning [J]. EURASIP Journal on Image and Video Processing , 2013 , 2013( 1 ): 1 － 15 .

Guha T , Nezhadarya E , Ward R K . Learning sparse models for image quality assessment [A]. 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) [C]. Florence, Italy : IEEE , 2014 . 151 － 155 .

Liang Y D , Wang J J , Wan X Y , et al . Image quality assessment using similar scene as reference [A]. Computer Vision－ECCV 2016 [C]. Cham, GER : Springer International Publishing , 2016 . 3 － 18 .

Liu T J , Liu K H , Lin J Y , et al . A ParaBoost method to image quality assessment [J]. IEEE Transactions on Neural Networks and Learning Systems , 2017 , 28 ( 1 ): 107 － 121 .

Gao F , Wang Y , Li P P , et al . DeepSim: Deep similarity for image quality assessment [J]. Neurocomputing , 2017 , 257 : 104 － 114 .

Wang S G , Deng C W , Lin W S , et al . NMF-based image quality assessment using extreme learning machine [J]. IEEE Transactions on Cybernetics , 2017 , 47 ( 1 ): 232 － 243 .

Kim J , Lee S . Deep learning of human visual sensitivity in image quality assessment framework [A]. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [C]. Florence, Italy : IEEE , 2017 . 1969 － 1977 .

Bosse S , Maniry D , Müller K R , et al . Deep neural networks for no-reference and full-reference image quality assessment [J]. IEEE Transactions on Image Processing , 2017 , 27 ( 1 ): 206 － 219 .

Ma K D , Duanmu Z F , Wang Z . Geometric transformation invariant image quality assessment using convolutional neural networks [A]. 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) [C]. Calgary, AB, Canada : IEEE , 2018 . 6732 － 6736 .

Prashnani E , Cai H , Mostofi Y , et al . PieAPP: Perceptual image-error assessment through pairwise preference [A]. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition [C]. Salt Lake City, UT, USA : IEEE , 2018 . 1808 － 1817 .

Ding K Y , Ma K D , Wang S Q , et al . Image quality assessment: Unifying structure and texture similarity [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 5810 , PP(99): 1.

Han S , Mao H , Dally W . Deep compression: Compressing deep neural networks with pruning , trained quantization and huffman coding[EB/OL]. https://arxiv.org/abs/1510.00149v4 https://arxiv.org/abs/1510.00149v4 ,

2020 .

Sun Y , Wang X G , Tang X O . Sparsifying neural network connections for face recognition [A]. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [C]. Las Vegas, NV, USA : IEEE , 2016 . 4856 － 4864 .

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

双通道深度图像先验降噪模型

基于人类视觉系统的图像感知哈希算法

基于结构信息提取的图像质量评价

一种基于WBCT的自然图像质量评价方法