Abstract：To make the inpainted images better meet human eye visual requirement,this paper proposes a MRF image inpainting algorithm based on structure offset statistics and multi-direction features.On one hand,to better maintain structure coherence of the inpainted images,the degraded image is partitioned into structure and non-structure parts according to the edge features extracted by Curvelet transform,and the offsets between the similar patches are respectively counted.For each part a few dominant offsets are selected as the candidate labels according to their statistics.On the other hand,to better maintain neighborhood consistence between adjacent pixels,the energy function is constructed by incorporating multi-direction features.Experimental results show that the proposed approach outperforms several state-of-the-art methods.
[1] Bertalmio M,Sapiro G,Caselles V,et al.Image inpainting[A].Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques[C].ACM Press,2000.417-424.
[2] Zhang H Y,Wu B,Peng Q,et al.Digital image inpainting based on P-harmonic energy minimization[J].Chinese Journal of Electronics,2007,16(3):525.
[3] Elad M,Starck J L,Querre P,et al.Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA)[J].Applied and Computational Harmonic Analysis,2005,19(3):340-358.
[4] 王斌,胡辽林,曹京京,等.基于小波域稀疏最优的图像修复方法[J].电子学报,2016,44(3):600-606. WANG B,HU L L,CAO J J,et al.Image restoration based on sparse-optimal strategy in wavelet domain[J].Acta Electronica Sinica,2016,44(3):600-606.(in Chinese)
[5] Criminisi A,Perez P,Toyama K.Object removal by exemplar-based inpainting[A].Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition[C].IEEE,2003.721-728.
[6] Komodakis N,Tziritas G.Image completion using efficient belief propagation via priority scheduling and dynamic pruning[J].IEEE Transactions on Image Processing,2007,16(11):2649-2661.
[7] 李志丹,和红杰,尹忠科,等.基于Curvelet方向特征的样本块图像修复算法[J].电子学报,2016,44(1):150-154. LI Z D,HE H J,YIN Z K,et al.Exemplar based image inpainting algorithm using direction features of Curvelet transform[J].Acta Electronica Sinica,2016,44(1):150-154.(in Chinese)
[8] Wang H,Jiang L,Liang R,et al.Exemplar-based image inpainting using structure consistent patch matching[J].Neurocomputing,2017,269:90-96.
[9] He K,Sun J.Image completion approaches using the statistics of similar patches[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2014,36(12):2423-2435.
[10] Xue W,Zhang R.Graph-based image completion using patch offsets and structure feature[A].Proceedings of Fifth International Conference on Graphic and Image Processing[C].SPIE,2014.906906-906906-9.
[11] Liu Y,Caselles V.Exemplar-based image inpainting using multiscale graph cuts[J].IEEE Transactions on Image Processing,2013,22(5):1699-1711.
[12] Ruzic T,Pizurica A.Context-aware patch-based image inpainting using Markov random field modeling[J].IEEE Transactions on Image Processing,2015,24(1):444-456.
[13] Yang S,Liu J,Song S,et al.Structure-guided image completion via regularity statistics[A].Proceedings of IEEE International Conference on Acoustics,Speech and Signal Processing[C].IEEE,2016.1711-1715.
[14] Ghorai M,Mandal S,Chanda B.A group-based image inpainting using patch refinement in MRF framework[J].IEEE Transactions on Image Processing,2018,27(2):556-567.
[15] Liu J,Yang S,Fang Y,et al.Structure-guided image inpainting using homography transformation[J].IEEE Transactions on Multimedia,2018,20(12):3252-3265.
[16] Kwatra V,Schödl A,Essa I,et al.Graphcut textures:image and video synthesis using graph cuts[J].ACM Transactions on Graphics,2003,22(3):277-286.
[17] Starck J,E Candes,D Donoho.The curvelet transform for image denoising[J].IEEE Transactions on Image Processing,2002,11(6):670-684.
2020, Vol. 48 
