Multiscale Remote Sensing Image Fusion Algorithm Based on Variational Segmentation

doi:10.3969/j.issn.0372-2112.2020.06.006

PDF(8919 KB)

ACTA ELECTRONICA SINICA ›› 2020, Vol. 48 ›› Issue (6) : 1084-1090. DOI: 10.3969/j.issn.0372-2112.2020.06.006

Multiscale Remote Sensing Image Fusion Algorithm Based on Variational Segmentation

QIN Fu-qiang, WANG Li-fang

Author information +

History +

Abstract

On the fusion of panchromatic and multispectral images, two important aspects, up-sampling of multispectral images and the difference of channel details, are ignored. For the former, the loss details of low-resolution images are estimated by using self-similar patch at different scales to improve up-sampling. For the latter, the local weighted dynamic sparse constraint is proposed based on the structural similarity between panchromatic images and spectral images in gradient domain. The new objective function based on variational method are proposed, the fidelity term and the regularization term of whose are constructed respectively according to the former and the latter. In addition, a multi-scale iterative fusion framework is presented, where the resolution of the fused image is gradually improved through iterations. The fused results of each iteration are more accurate, so the final fused image is improved. Our algorithm is compared with Brovey and other component substitution algorithms, P+XS and other variational algorithms, MTF_GLP and other multi-resolution analysis algorithms. The experimental results show that the fusion results of this algorithm have good visual effect, and the objective evaluation index is better than the average of the optimal value of all comparison algorithms.

Key words

multispectral image / remote sensing image fusion / multiscale self-similarity / local weighted dynamic sparse constraint

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations

QIN Fu-qiang, WANG Li-fang. Multiscale Remote Sensing Image Fusion Algorithm Based on Variational Segmentation[J]. Acta Electronica Sinica, 2020, 48(6): 1084-1090. https://doi.org/10.3969/j.issn.0372-2112.2020.06.006

References

[1] Ghassemian,Hassan.A review of remote sensing image fusion methods[J].Information Fusion,2016,32:75-89.
[2] Tu T M,Huang P S,Hung C L,et al.A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery[J].IEEE Geoscience and Remote Sensing Letters,2004,1(4):309-312.
[3] Rahmani S,Strait M,et al.An adaptive IHS pan-sharpening method[J].IEEE Geoscience and Remote Sensing Letters,2010,7(4):746-750.
[4] Ghahremani M,Ghassemian H.Nonlinear IHS:a promising method for pan-sharpening[J].IEEE Geoscience and Remote Sensing Letters,2016,13(11):1-5.
[5] Ballester C,Caselles V,Igual L,et al.A variational model for P+XS image fusion[J].International Journal of Computer Vision,2006,69(1):43-58.
[6] Liu,J G.Smoothing filter-based intensity modulation:a spectral preserve image fusion technique for improving spatial details[J].International Journal of Remote Sensing,2000,21(18):3461-3472.
[7] Zhou Z M,Yang P L,Li Y X,et al.Joint IHS and variational methods for pan-sharpening of very high resolution imagery[A].IGARSS 2013[C].Melbourne,VIC,Australia:IEEE,2013.2597-2600.
[8] Chen C,Li Y Q,et al.Image fusion with local spectral consistency and dynamic gradient sparsity[A].2014 Conference on Computer Vision and Pattern Recognition[C].Columbus:IEEE,2014.2760-2765.
[9] Zhu X X,Bamler R.A sparse image fusion algorithm with application to pan-sharpening[J].IEEE Transactions on Geoscience and Remote Sensing,2013,51(5):2827-2836.
[10] Li S,Yin H,Fang L.Remote sensing image fusion via sparse representations over learned dictionaries[J].IEEE Transactions on Geoscience and Remote Sensing,2013,51(9):4779-4789.
[11] 潘宗序,禹晶,肖创柏,等.基于自适应多字典学习的单幅图像超分辨率算法[J].电子学报,2015,43(2):209-216. Pan Zong-xu,Yu Jin,Xiao Chuang-bo,et al.Single image super-resolution based on adaptive multi-dictionary learning[J].Acta Electronica Sinica,2015,43(2):209-216.(in Chinese)
[12] 宋云,李雪玉,等.基于非局部相似块低秩的压缩感知图像重建算法[J].电子学报,2017,45(3):695-703. Song Yun,Li Xue-yu,et al.Compressed sensing image reconstruction based on low rank of non-local similar patches[J].Acta Electronica Sinica,2017,45(3):695-703.(in Chinese)
[13] Glasner D,Bagon S,Irani M.Super-resolution from a single image[A].2009 IEEE 12th International Conference on Computer Vision[C].Kyoto,Japan:IEEE,2009.349-356.
[14] Gillespie A R.Color enhancement of highly correlated images I.Decorrelation and HSI contrast stretches[J].Remote Sensing of Environment,1986,20(3):209-235.
[15] Alparone L,Baronti S,Selva M.MS+Pan image fusion by enhanced gram-schmidt spectral sharpening[A].Proceedings of the 26th EARSe Symposium,New Strategies for European Remote Sensing[C].Varsovie:EARSe,2006.26-31.
[16] Alparone L,Aiazzi B,Garzelli A,et al.Sharpening of very high resolution images with spectral distortion minimization[A].International Geoscience and Remote Sensing Symposium[C].Toulouse:IEEE,2003.458-460.
[17] Li S,Kang X,Hu J.Image fusion with guided filtering[J].IEEE Transactions on Image Processing,2013,22(7):2864-2875.
[18] Aiazzi B,Alparone L,Baronti S,et al.MTF-tailored multiscale fusion of high-resolution ms and pan imagery[J].Photogrammetric Engineering & Remote Sensing,2006,72(5):591-596.
[19] Choi J,Yu K,Kim Y.A new adaptive component-substitution-based satellite image fusion by using partial replacement[J].IEEE Transactions on Geoscience and Remote Sensing,2011,49(1):295-309.