Research on Super-Resolution Reconstruction Algorithm of Cultural Relic Images

LIU Jie; GE Yi-fan; TIAN Ming

doi:10.12263/DZXB.20211647

您当前的位置：

首页 >

文章列表页 >

Research on Super-Resolution Reconstruction Algorithm of Cultural Relic Images

PAPERS | 更新时间：2025-07-02

- Research on Super-Resolution Reconstruction Algorithm of Cultural Relic Images
- ACTA ELECTRONICA SINICA Vol. 51, Issue 1, Pages: 139-145(2023)
- 作者机构：
  
  1.哈尔滨理工大学测控技术与通信工程学院，黑龙江哈尔滨 150080
  2.中国电信黑龙江省分公司，黑龙江哈尔滨 150000
- 作者简介：
- 基金信息：
- DOI：10.12263/DZXB.20211647
  CLC： TP391.41;TP18
- Received：12 December 2021，
  
  Revised：2022-06-08，
  
  Published：25 January 2023
- 稿件说明：
移动端阅览
刘杰,葛一凡,田明.文物图像的超分辨率重建算法研究[J].电子学报,2023,51(01):139-145.

LIU Jie,GE Yi-fan,TIAN Ming.Research on Super-Resolution Reconstruction Algorithm of Cultural Relic Images[J].ACTA ELECTRONICA SINICA,2023,51(01):139-145.
刘杰,葛一凡,田明.文物图像的超分辨率重建算法研究[J].电子学报,2023,51(01):139-145. DOI： 10.12263/DZXB.20211647.

LIU Jie,GE Yi-fan,TIAN Ming.Research on Super-Resolution Reconstruction Algorithm of Cultural Relic Images[J].ACTA ELECTRONICA SINICA,2023,51(01):139-145. DOI： 10.12263/DZXB.20211647.

摘要

文物的数字化保护与分类识别是当前图像处理研究的热点之一.针对常规超分辨率算法不能充分描述现实世界中文物图像复杂纹理结构的问题，本文提出一种基于回归环金字塔型生成对抗网络的文物图像超分辨率算法（Closed-loop Pyramid Information Generative Adversarial Network，CPIGAN）.考虑文物图像的噪声等不定因素，本文采用不同的降采样方式构建了两种文物数据集且探索了一种改进信息块提取策略，提高了原始高分辨率文物图像中高频信息的利用率.本文进一步设计了一种金字塔型生成对抗网络并融入回归环结构，增强了网络从低分辨率图像到高分辨率图像映射的能力.基于自建文物图像数据集，本文算法与多种算法进行了实验对比分析，多个客观指标均有所提升且重建图像主观上更符合人类视觉标准.

Abstract

The digital conservation and classification of cultural relics is one of the hotspots of current image processing research. In view of the problem that conventional super-resolution algorithms cannot fully describe the complex texture structure of cultural relics images in the real world

this paper proposes a super-resolution algorithm for cultural relics images based on a closed-loop pyramid information generative adversarial network (CPIGAN). Considering the noise of real cultural relics and other uncertain factors

this paper uses different down-sampling methods to construct two cultural relics datasets and explores an improved information block extraction. This strategy improves the utilization of high-frequency information in the original high-resolution cultural relic images. This paper further designs a pyramid-shaped generative confrontation network and incorporates the regression loop structure to enhance the network's ability to map from low-resolution images to high-resolution images. Based on the self-built cultural relic image data set

the algorithm in this paper has been compared and analyzed experimentally with a variety of algorithms. Several objective indicators have been improved

and the reconstructed images are subjectively more in line with human visual standards.

关键词

Keywords

references

陈根翠 . 文物保护中数字图像修复技术的应用 [J]. 东方收藏 , 2021 , ( 7 ): 76 - 77 .

CHEN G C . Application of digital image restoration technology in cultural relics protectionheritage conservation [J]. Oriental Collection , 2021 , ( 7 ): 76 - 77 . (in Chinese)

陆正杰 . 文物碎片特征提取与分类算法研究 [D]. 西安 : 西北大学 , 2020 .

LU Z J . Research on feature extraction and classification algorithm of cultural relic fragments [D]. Xi'an : Northwest University , 2020 . (in Chinese)

黄婧 , 刘建宇 , 曲亮 , 等 . 图像建模拍摄方法在文物数字化保护中的应用研究 [J]. 文博 , 2020 , ( 5 ): 92 - 99 .

HUANG J , LIU J Y , QU L , et al . The application of image modeling photographing method in the digital conservation of cultural relics [J]. Relics and Museolgy , 2020 , ( 5 ): 92 - 99 . (in Chinese)

唐艳秋 , 潘泓 , 朱亚平 , 等 . 图像超分辨率重建研究综述 [J]. 电子学报 , 2020 , 48 ( 7 ): 1407 - 1420 .

TANG Y Q , PAN H , ZHU Y P , et al . A survey of image super-resolution reconstruction [J]. Acta Electronica Sinica , 2020 , 48 ( 7 ): 1407 - 1420 . (in Chinese)

朱欣娟 , 雷倩 , 吴晓军 . 基于生成式对抗网络的文物图像超分辨率重建及色彩修复 [J]. 西安工程大学学报 , 2021 , 35 ( 3 ): 86 - 92 .

ZHU X J , LEI Q , WU X J . Super-resolution reconstruction and color restoration of cultural relics images based on generative adversarial network [J]. Journal of Xi'an Polytechnic University , 2021 , 35 ( 3 ): 86 - 92 . (in Chinese)

HA V K , REN J C , XU X Y , et al . Deep learning based single image super-resolution: A survey [J]. International Journal of Automation and Computing , 2019 , 16 ( 4 ): 413 - 426 .

赵小强 , 宋昭漾 . 多级跳线连接的深度残差网络超分辨率重建 [J]. 电子与信息学报 , 2019 , 41 ( 10 ): 2501 - 2508 .

ZHAO X Q , SONG Z Y . Super-resolution reconstruction of deep residual network with multi-level skip connections [J]. Journal of Electronics ＆ Information Technology , 2019 , 41 ( 10 ): 2501 - 2508 . (in Chinese)

黄健 , 赵元元 , 郭苹 , 等 . 深度学习的单幅图像超分辨率重建方法综述 [J]. 计算机工程与应用 , 2021 , 57 ( 18 ): 13 - 23 .

HUANG J , ZHAO Y Y , GUO P , et al . Survey of single image super-resolution based on deep learning [J]. Computer Engineering and Applications , 2021 , 57 ( 18 ): 13 - 23 . (in Chinese)

DONG C , LOY C C , HE K M , et al . Learning a deep convolutional network for image super-resolution [C]// 2014 European Conference on Computer Vision . Zurich : Springer Cham , 2014 : 184 - 199 .

DONG C , LOY C C , TANG X O . Accelerating the super-resolution convolutional neural network [C]// 2016 European Conference on Computer Vision . Amsterdam : Springer Cham , 2016 : 391 - 407 .

KIM J , LEE J K , LEE K M . Accurate image super-resolution using very deep convolutional networks [C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition . Las Vegas : IEEE , 2016 : 1646 - 1654 .

LAI W S , HUANG J B , AHUJA N , et al . Deep Laplacian pyramid networks for fast and accurate super-resolution [C]// 2017 IEEE Conference on Computer Vision and Pattern Recognition . Honolulu : IEEE , 2017 : 5835 - 5843 .

葛一凡 , 刘杰 , 祁箬 . 一种基于生成对抗网络的文物图像超分辨率方法 : 202110880696.1 [P]. 2021-11-08 .

LEDIG C , THEIS L , HUSZÁR F , et al . Photo-realistic single image super-resolution using a generative adversarial network [C]// 2017 IEEE Conference on Computer Vision and Pattern Recognition . Honolulu : IEEE , 2017 : 105 - 114 .

WANG X T , YU K , WU S X , et al . ESRGAN: Enhanced super-resolution generative adversarial networks [C]// 2018 European Conference on Computer Vision . Munich : Springer , 2018 : 63 - 79 .

MA C , RAO Y M , CHENG Y A , et al . Structure-preserving super resolution with gradient guidance [C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Seattle : IEEE , 2020 : 7766 - 7775 .

KONG X T , ZHAO H Y , QIAO Y , et al . ClassSR: A general framework to accelerate super-resolution networks by data characteristic [C]// 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Nashville : IEEE , 2021 : 12011 - 12020 .

BELL S , UPCHURCH P , SNAVELY N , et al . Material recognition in the wild with the Materials in Context Database [C]// 2015 IEEE Conference on Computer Vision and Pattern Recognition . Boston : IEEE , 2015 : 3479 - 3487 .

CHEN J W , CHEN J W , CHAO H Y , et al . Image blind denoising with generative adversarial network based noise modeling [C]// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Salt Lake City : IEEE , 2018 : 3155 - 3164 .

ZHOU R F , SÜSSTRUNK S . Kernel modeling super-resolution on real low-resolution images [C]// 2019 IEEE/CVF International Conference on Computer Vision . Seoul : IEEE , 2019 : 2433 - 2443 .

JI X Z , CAO Y , TAI Y , et al . Real-world super-resolution via kernel estimation and noise injection [C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops . Seattle : IEEE , 2020 : 1914 - 1923 .

GUO Y , CHEN J , WANG J D , et al . Closed-loop matters: Dual regression networks for single image super-resolution [C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Seattle : IEEE , 2020 : 5406 - 5415 .

YUAN F , HUANG L F , YAO Y . An improved PSNR algorithm for objective video quality evaluation [C]// 2007 Chinese Control Conference . Zhangjiajie : IEEE , 2007 : 376 - 380 .

WANG Z , BOVIK A C , SHEIKH H R , et al . Image quality assessment: From error visibility to structural similarity [J]. IEEE Transactions on Image Processing , 2004 , 13 ( 4 ): 600 - 612 .

ZHANG R , ISOLA P , EFROS A A , et al . The unreasonable effectiveness of deep features as a perceptual metric [C]// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Salt Lake City : IEEE , 2018 : 586 - 595 .

SOH J W , PARK G Y , JO J , et al . Natural and realistic single image super-resolution with explicit natural manifold discrimination [C]// 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Long Beach : IEEE , 2019 : 8114 - 8123 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Attention Mechanism Optimized Generative Adversarial Networks and Their Application in Sea Clutter Simulation

Land-Sea Clutter Image Enhancement and Detector Design for Sky-Wave Over-the-Horizon Radar

Refocusing for Three-Dimensional Rotating Ship Targets in SAR Images Based on Minimum Entropy Criteria and Generative Adversarial Network

Scene Text Image Super-Resolution Reconstruction Based on Perceiving Multi-Domain Character Distance

Related Author

LIU Jie

GE Yi-fan

ZHANG Su-kai

CHEN Peng

DONG Zi-ying

WANG Wei

LUO Zhong-tao

GONG Yan-ru

Related Institution

College of Measurement and Control Technology and Communication Engineering， Harbin University of Science and Technology

School of Information Engineering, Chang’an University

School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications

Nanjing Research Institute of Electronics Technology

School of Electronics and Information Engineering， Harbin Institute of Technology

⁰