Review and Prospect of Full Reference Image Quality Assessment

GAO Min-juan; DANG Hong-she; WEI Li-li; LIU Guo-jun; ZHANG Xuan-de

doi:10.12263/DZXB.20200780

您当前的位置：

首页 >

文章列表页 >

Review and Prospect of Full Reference Image Quality Assessment

SURVEYS AND REVIEWS | 更新时间：2025-12-08

- Review and Prospect of Full Reference Image Quality Assessment
- ACTA ELECTRONICA SINICA Vol. 49, Issue 11, Pages: 2261-2272(2021)
- 作者机构：
  
  1.陕西科技大学电气与控制工程学院，陕西西安 710021
  2.宁夏大学数学统计学院，宁夏银川 750021
  3.陕西科技大学电子信息与人工智能学院，陕西西安 710021
- 作者简介：
- 基金信息：
- DOI：10.12263/DZXB.20200780
  CLC： TP391;
- Received：27 July 2020，
  
  Revised：2021-03-09，
  
  Published：25 November 2021
- 稿件说明：
移动端阅览
高敏娟,党宏社,魏立力等.全参考图像质量评价回顾与展望[J].电子学报,2021,49(11):2261-2272.

GAO Min-juan,DANG Hong-she,WEI Li-li,et al.Review and Prospect of Full Reference Image Quality Assessment[J].ACTA ELECTRONICA SINICA,2021,49(11):2261-2272.
高敏娟,党宏社,魏立力等.全参考图像质量评价回顾与展望[J].电子学报,2021,49(11):2261-2272. DOI： 10.12263/DZXB.20200780.

GAO Min-juan,DANG Hong-she,WEI Li-li,et al.Review and Prospect of Full Reference Image Quality Assessment[J].ACTA ELECTRONICA SINICA,2021,49(11):2261-2272. DOI： 10.12263/DZXB.20200780.

摘要

全参考图像质量评价(Full Reference Image Quality Assessment

FR-IQA)是IQA领域广为研究的类型之一.本文回顾了FR-IQA的发展历程，对FR-IQA应用现状和通用FR-IQA问题的构建进行综述，以及对FR-IQA算法进行总结和梳理.并在此基础上，重点分析了现有研究中存在的问题，包括问题构建的合理性、建模的全面性问题、知识驱动与数据驱动结合的问题等.基于对主观评价过程的深入分析，结合现有研究存在的问题，探讨了主观评分采用模糊建模和知识与数据联合驱动构建算法两个可能的研究方向，以期对后续的研究者提供参考.

Abstract

Full reference image quality assessment (FR-IQA) is one of the types widely studied in the field of IQA. This paper reviews the development of FR-IQA

summarizes the application status of FR-IQA and the construction of general FR-IQA problems

and summarizes and combs FR-IQA algorithms. And on this basis

it focuses on the problems existing in the existing research

including the rationality of the problem construction

the comprehensive problem of modeling

and the problem of the combination of knowledge-driven and data-driven. Finally

based on the in-depth analysis of the subjective evaluation process and the existing problems in the existing research

the two possible research directions of subjective scoring using fuzzy modeling and knowledge-data-driven construction algorithm are discussed

in order to provide reference for subsequent researchers.

关键词

Keywords

references

Chandler D M . Seven challenges in image quality assessment: Past, present, and future research [J]. ISRN Signal Processing , 2013 , 2013 : 1 － 53 .

Mohammadi P , Ebrahimi-Moghadam A , Shirani S . Subjective and objective quality assessment of image: A survey [J]. Majlesi Journal of Electrical Engineering , 2014 , 9 ( 1 ): 419 － 423 .

Mannos J , Sakrison D . The effects of a visual fidelity criterion of the encoding of images [J]. IEEE Transactions on Information Theory , 1974 , 20 ( 4 ): 525 － 536 .

Buades A , Coll B , Morel J M . A review of image denoising algorithms, with a new one [J]. Multiscale Modeling & Simulation , 2005 , 4 ( 2 ): 490 － 530 .

李亮亮 . 基于非下采样剪切波变换的图像增强算法研究 [D]. 长春 : 吉林大学 , 2019 .

Li L L . The research of image enhancement algorithm based on nonsubsampled shearlet transform [D]. Changchun, China : Jilin University , 2019 . (in Chinese)

Wang Z , Bovik A C , Sheikh H R , et al . Image quality assessment: From error visibility to structural similarity [J]. IEEE Transactions on Image Processing , 2004 , 13 ( 4 ): 600 － 612 .

沈瑜 , 陈小朋 , 刘成 , 等 . 基于混合模型驱动的红外与可见光图像融合 [J]. 控制与决策 , 2021 , 36 ( 9 ): 2143 － 2151 .

Shen Y , Chen X P , Liu C , et al . Infrared and visible image fusion based on hybrid model driving [J]. Control and Decision , 2021 , 36 ( 9 ): 2143 － 2151 . (in Chinese)

Ding K Y , Ma K D , Wang S Q , et al . Comparison of full-reference image quality models for optimization of image processing systems [J]. International Journal of Computer Vision , 2021 , 129 ( 4 ): 1258 － 1281 .

Zhao H , Gallo O , Frosio I , et al . Loss functions for image restoration with neural networks [J]. IEEE Transactions on Computational Imaging , 2017 , 3 ( 1 ): 47 － 57 .

Wang Z , Simoncelli E P , Bovik A C . Multiscale structural similarity for image quality assessment [A]. The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers[C]. Pacific Grove , CA, USA : IEEE , 2003 . 1398 － 1402 .

Laparra V , Ballé J , Berardino A , et al . Perceptual image quality assessment using a normalized Laplacian pyramid [J]. Electronic Imaging , 2016 , 2016( 16 ): 1 － 6 .

Laparra V , Berardino A , Ballé J , et al . Perceptually optimized image rendering [J]. Journal of the Optical Society of America A: Optics , Image Science, and Vision, 2017 , 34 ( 9 ): 1511 － 1525 .

Ma J J , Nakarmi U , Kin C Y S , et al . Diagnostic image quality assessment and classification in medical imaging: Opportunities and challenges [A]. 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI) [C]. Iowa City, IA, USA : IEEE , 2020 . 337 － 340 .

郭从洲 , 李可 , 李贺 , 等 . 遥感图像质量等级分类的深度卷积神经网络方法 [J/OL]. 武汉大学学报(信息科学版) , 2020 , DOI: 10.13203/j.whugis20200292 http://dx.doi.org/10.13203/j.whugis20200292 .

GUO C Z , LI K , LI H , et al . A deep convolution -al neural network method for remote sensing image quality classification [J/OL]. Geomatics and Information Sinence of Wuhan University , 2020 , DOI: 10.13203/j.whugis20200292. http://dx.doi.org/10.13203/j.whugis20200292. (in Chinese)

李毅红 , 韩焱 , 潘晋孝 , 等 . 基于递变能量线性约束的X射线图像质量评价方法 [J]. 电子学报 , 2017 , 45 ( 3 ): 669 － 673 .

Li Y H , Han Y , Pan J X , et al . X-ray image quality evaluation based on linear constraint with variable energy [J]. Acta Electronica Sinica , 2017 , 45 ( 3 ): 669 － 673 . (in Chinese)

Sheikh H R , Wang Z , Bovik A C , et al . Image and video quality assessment research at LIVE [EB/OL]. http://live.ece.utexas.edu/research/quality http://live.ece.utexas.edu/research/quality , 2020 .

Larson E C , Chandler D M . Categorical subjective image quality database [EB/OL]. http://vision.okstate.edu/csiq http://vision.okstate.edu/csiq , 2020 .

Ponomarenko N , Egiazarian K . Tampere image database TID2008 [EB/OL]. http://www.ponomarenko.info/tid2008 http://www.ponomarenko.info/tid2008 , 2020 .

Ponomarenko N , Jin L N , Ieremeiev O , et al . Image database TID2013: Peculiarities, results and perspectives [J]. Signal Processing: Image Communication , 2015 , 30 : 57 － 77 .

Ninassi A , Callet P L , Autrusseau F . Subjective quality assessment IVC database 2005 [EB/OL]. http://www2.irccyn.ecnantes.fr/ivcdb http://www2.irccyn.ecnantes.fr/ivcdb , 2020 .

Chandler D M , Hemami S S . A 57 Database 2007 [EB/OL]. http://foulard.ece.cornell.edu/dmc27/vsnr/vsnr.html.A57 http://foulard.ece.cornell.edu/dmc27/vsnr/vsnr.html.A57 , 2020 .

Ma K D , Duanmu Z F , Wu Q B , et al . Waterloo exploration database: New challenges for image quality assessment models [J]. IEEE Transactions on Image Processing , 2017 , 26 ( 2 ): 1004 － 1016 .

Zhang R , Isola P , Efros A A , et al . The unreasonable effectiveness of deep features as a perceptual metric [A]. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition [C]. Salt Lake City, UT, USA : IEEE , 2018 . 586 － 595 .

Lin H H , Hosu V , Saupe D . KADID-10k: A large-scale artificially distorted IQA database [A]. 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX) [C]. Berlin, Germany : IEEE , 2019 . 1 － 3 .

Wang Z , Simoncelli E P . Maximum differentiation (MAD) competition: A methodology for comparing computational models of perceptual quantities [J]. Journal of Vision , 2008 , 8 ( 12 ): 1 － 8 .

Ma K D , Duanmu Z F , Wang Z , et al . Group maximum differentiation competition: Model comparison with few samples [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2020 , 42 ( 4 ): 851 － 864 .

Sheikh H R , Bovik A C , de Veciana G . An information fidelity criterion for image quality assessment using natural scene statistics [J]. IEEE Transactions on Image Processing , 2005 , 14 ( 12 ): 2117 － 2128 .

Sheikh H R , Bovik A C . Image information and visual quality [J]. IEEE Transactions on Image Processing , 2006 , 15 ( 2 ): 430 － 444 .

Sheikh H R , Sabir M F , Bovik A C . A statistical evaluation of recent full reference image quality assessment algorithms [J]. IEEE Transactions on Image Processing , 2006 , 15 ( 11 ): 3440 － 3451 .

Shnayderman A , Gusev A , Eskicioglu A M . An SVD-based grayscale image quality measure for local and global assessment [J]. IEEE Transactions on Image Processing , 2006 , 15 ( 2 ): 422 － 429 .

Wang Z , Shang X L . Spatial pooling strategies for perceptual image quality assessment [A]. 2006 International Conference on Image Processing [C]. Atlanta, GA, USA : IEEE , 2006 . 2945 － 2948 .

Chen G H , Yang C L , Xie S L . Gradient-based structural similarity for image quality assessment [A]. 2006 International Conference on Image Processing [C]. Atlanta, GA, USA : IEEE , 2006 . 2929 － 2932 .

Chandler D M , Hemami S S . VSNR: A wavelet-based visual signal-to-noise ratio for natural images [J]. IEEE Transactions on Image Processing , 2007 , 16 ( 9 ): 2284 － 2298 .

Sampat M P , Wang Z , Gupta S , et al . Complex wavelet structural similarity: A new image similarity index [J]. IEEE Transactions on Image Processing , 2009 , 18 ( 11 ): 2385 － 2401 .

Moorthy A K , Bovik A C . Visual importance pooling for image quality assessment [J]. IEEE Journal of Selected Topics in Signal Processing , 2009 , 3 ( 2 ): 193 － 201 .

Larson E C , Chandler D M . Most apparent distortion: Full-reference image quality assessment and the role of strategy [J]. Journal of Electronic Imaging , 2010 , 19 ( 1 ): 011006 .

Zhang L , Zhang L , Mou X Q . RFSIM: A feature based image quality assessment metric using Riesz transforms [A]. 2010 IEEE International Conference on Image Processing [C]. Hong Kong, China : IEEE , 2010 . 321 － 324 .

Wang Z , Li Q . Information content weighting for perceptual image quality assessment [J]. IEEE Transactions on Image Processing , 2011 , 20 ( 5 ): 1185 － 1198 .

Zhang L , Zhang L , Mou X Q , et al . FSIM: A feature similarity index for image quality assessment [J]. IEEE Transactions on Image Processing , 2011 , 20 ( 8 ): 2378 － 2386 .

Liu A M , Lin W S , Narwaria M . Image quality assessment based on gradient similarity [J]. IEEE Transactions on Image Processing , 2012 , 21 ( 4 ): 1500 － 1512 .

Zhu J Y , Wang N C . Image quality assessment by visual gradient similarity [J]. IEEE Transactions on Image Processing , 2012 , 21 ( 3 ): 919 － 933 .

Capodiferro L , Jacovitti G , Di Claudio E D . Two-dimensional approach to full-reference image quality assessment based on positional structural information [J]. IEEE Transactions on Image Processing , 2012 , 21 ( 2 ): 505 － 516 .

Xue W F , Zhang L , Mou X Q , et al . Gradient magnitude similarity deviation: A highly efficient perceptual image quality index [J]. IEEE Transactions on Image Processing , 2014 , 23 ( 2 ): 684 － 695 .

Zhang X D , Feng X C , Wang W W , et al . Edge strength similarity for image quality assessment [J]. IEEE Signal Processing Letters , 2013 , 20 ( 4 ): 319 － 322 .

Wu J J , Lin W S , Shi G M , et al . Perceptual quality metric with internal generative mechanism [J]. IEEE Transactions on Image Processing , 2013 , 22 ( 1 ): 43 － 54 .

Chang H W , Yang H , Gan Y , et al . Sparse feature fidelity for perceptual image quality assessment [J]. IEEE Transactions on Image Processing , 2013 , 22 ( 10 ): 4007 － 4018 .

Zhang L , Shen Y , Li H Y . VSI: A visual saliency-induced index for perceptual image quality assessment [J]. IEEE Transactions on Image Processing , 2014 , 23 ( 10 ): 4270 － 4281 .

Preiss J , Fernandes F , Urban P . Color-image quality assessment: From prediction to optimization [J]. IEEE Transactions on Image Processing , 2014 , 23 ( 3 ): 1366 － 1378 .

Pei S C , Chen L H . Image quality assessment using human visual DOG model fused with random forest [J]. IEEE Transactions on Image Processing , 2015 , 24 ( 11 ): 3282 － 3292 .

Lee D , Plataniotis K N . Towards a full-reference quality assessment for color images using directional statistics [J]. IEEE Transactions on Image Processing , 2015 , 24 ( 11 ): 3950 － 3965 .

Nafchi H Z , Shahkolaei A , Hedjam R , et al . Mean deviation similarity index: Efficient and reliable full-reference image quality evaluator [J]. IEEE Access , 2016 , 4 : 5579 － 5590 .

Bae S H , Kim M . A novel image quality assessment with globally and locally consilient visual quality perception [J]. IEEE Transactions on Image Processing , 2016 , 25 ( 5 ): 2392 － 2406 .

Reisenhofer R , Bosse S , Kutyniok G , et al . A Haar wavelet-based perceptual similarity index for image quality assessment [J]. Signal Processing: Image Communication , 2018 , 61 : 33 － 43 .

Li L D , Cai H , Zhang Y B , et al . Sparse representation-based image quality index with adaptive sub-dictionaries [J]. IEEE Transactions on Image Processing , 2016 , 25 ( 8 ): 3775 － 3786 .

Ding L , Huang H , Zang Y . Image quality assessment using directional anisotropy structure measurement [J]. IEEE Transactions on Image Processing , 2017 , 26 ( 4 ): 1799 － 1809 .

Gu K , Li L D , Lu H , et al . A fast reliable image quality predictor by fusing micro- and macro-structures [J]. IEEE Transactions on Industrial Electronics , 2017 , 64 ( 5 ): 3903 － 3912 .

Sun W , Liao Q M , Xue J H , et al . SPSIM: A superpixel-based similarity index for full-reference image quality assessment [J]. IEEE Transactions on Image Processing , 2018 , 27 ( 9 ): 4232 － 4244 .

Ahar A , Barri A , Schelkens P . From sparse coding significance to perceptual quality: A new approach for image quality assessment [J]. IEEE Transactions on Image Processing , 2018 , 27 ( 2 ): 879 － 893 .

Di Claudio E D , Jacovitti G . A detail-based method for linear full reference image quality prediction [J]. IEEE Transactions on Image Processing , 2018 , 27 ( 1 ): 179 － 193 .

Jia H Z , Zhang L , Wang T H . Contrast and visual saliency similarity-induced index for assessing image quality [J]. IEEE Access , 2018 , 6 : 65885 － 65893 .

Temel D , AlRegib G . Perceptual image quality assessment through spectral analysis of error representations [J]. Signal Processing: Image Communication , 2019 , 70 : 37 － 46 .

Kim W , Nguyen A D , Lee S , et al . Dynamic receptive field generation for full-reference image quality assessment [J]. IEEE Transactions on Image Processing , 2020 , 29 : 4219 － 4231 .

Ling W Y , Hu Y . Machine learning to design full-reference image quality assessment algorithm [J]. TELKOMNIKA Indonesian Journal of Electrical Engineering , 2013 , 11 ( 6 ): 3439 － 3444 .

Narwaria M , Lin W S . SVD-based quality metric for image and video using machine learning [J]. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) , 2012 , 42 ( 2 ): 347 － 364 .

Liu T J , Lin W S , Kuo C C J . Image quality assessment using multi-method fusion [J]. IEEE Transactions on Image Processing , 2013 , 22 ( 5 ): 1793 － 1807 .

Gastaldo P , Zunino R , Redi J . Supporting visual quality assessment with machine learning [J]. EURASIP Journal on Image and Video Processing , 2013 , 2013( 1 ): 1 － 15 .

Guha T , Nezhadarya E , Ward R K . Learning sparse models for image quality assessment [A]. 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) [C]. Florence, Italy : IEEE , 2014 . 151 － 155 .

Liang Y D , Wang J J , Wan X Y , et al . Image quality assessment using similar scene as reference [A]. Computer Vision－ECCV 2016 [C]. Cham, GER : Springer International Publishing , 2016 . 3 － 18 .

Liu T J , Liu K H , Lin J Y , et al . A ParaBoost method to image quality assessment [J]. IEEE Transactions on Neural Networks and Learning Systems , 2017 , 28 ( 1 ): 107 － 121 .

Gao F , Wang Y , Li P P , et al . DeepSim: Deep similarity for image quality assessment [J]. Neurocomputing , 2017 , 257 : 104 － 114 .

Wang S G , Deng C W , Lin W S , et al . NMF-based image quality assessment using extreme learning machine [J]. IEEE Transactions on Cybernetics , 2017 , 47 ( 1 ): 232 － 243 .

Kim J , Lee S . Deep learning of human visual sensitivity in image quality assessment framework [A]. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [C]. Florence, Italy : IEEE , 2017 . 1969 － 1977 .

Bosse S , Maniry D , Müller K R , et al . Deep neural networks for no-reference and full-reference image quality assessment [J]. IEEE Transactions on Image Processing , 2017 , 27 ( 1 ): 206 － 219 .

Ma K D , Duanmu Z F , Wang Z . Geometric transformation invariant image quality assessment using convolutional neural networks [A]. 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) [C]. Calgary, AB, Canada : IEEE , 2018 . 6732 － 6736 .

Prashnani E , Cai H , Mostofi Y , et al . PieAPP: Perceptual image-error assessment through pairwise preference [A]. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition [C]. Salt Lake City, UT, USA : IEEE , 2018 . 1808 － 1817 .

Ding K Y , Ma K D , Wang S Q , et al . Image quality assessment: Unifying structure and texture similarity [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 5810 , PP(99): 1.

Han S , Mao H , Dally W . Deep compression: Compressing deep neural networks with pruning , trained quantization and huffman coding[EB/OL]. https://arxiv.org/abs/1510.00149v4 https://arxiv.org/abs/1510.00149v4 ,

2020 .

Sun Y , Wang X G , Tang X O . Sparsifying neural network connections for face recognition [A]. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) [C]. Las Vegas, NV, USA : IEEE , 2016 . 4856 － 4864 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Dual-Channel Deep Image Prior for Image Denoising

Image Perceptual Hashing Based on Human Visual System

Image Quality Assessment Based on Structural Information Extraction

A Natural Image Quality Assessment Metric Based on Wavelet-based Contourlet Transform

Related Author

CHEN Xiao-jun

CHENG Xiao-hui

LUO Jie

XIAO Nan

XU Shao-ping

GAO Wen-rui

YANG Chun-ling

ZHANG Hui

Related Institution

School of Mathematics and Computer Sciences， Nanchang University

Infectious Disease Hospital Affiliated to Nanchang University

School of Electronic and Information Engineering, South China University of Technology

Information Countermeasure Technology Institute Harbin Iinstitute of Technolgy Harbin Heilongjiang China

Information Security Technology Research Center Shenzhen Graduate School Harbin Institute of Technology Shenzhen Guangdong China

⁰