Multi-layer Perceptron Combined with Radiative Transfer Model for Complex Land Surface Cloud Detection

DENG Meng-jiao; XU Xin; MA Ying-ying; GONG Wei; JIN Shi-kuan; HU Rui-min

doi:10.12263/DZXB.20210636

您当前的位置：

首页 >

文章列表页 >

Multi-layer Perceptron Combined with Radiative Transfer Model for Complex Land Surface Cloud Detection

CROSS-DISCIPLINARY INNOVATIONS OF MACHINE LEARNING | 更新时间：2025-12-08

- Multi-layer Perceptron Combined with Radiative Transfer Model for Complex Land Surface Cloud Detection
- ACTA ELECTRONICA SINICA Vol. 50, Issue 4, Pages: 932-942(2022)
- 作者机构：
  
  1.武汉科技大学计算机科学与技术学院，湖北武汉 430065
  2.武汉科技大学智能信息处理与实时工业系统重点实验室，湖北武汉 430065
  3.武汉大学测绘遥感信息工程国家重点实验室，湖北武汉 430072
  4.武汉大学计算机学院，湖北武汉 430072
- 作者简介：
- 基金信息：
- DOI：10.12263/DZXB.20210636
  CLC： TP751;
- Received：17 July 2021，
  
  Revised：2022-03-07，
  
  Published：25 April 2022
- 稿件说明：
移动端阅览
邓梦娇,徐新,马盈盈等.多层感知机结合辐射传输模型的复杂陆地表面云检测[J].电子学报,2022,50(04):932-942.

DENG Meng-jiao,XU Xin,MA Ying-ying,et al.Multi-layer Perceptron Combined with Radiative Transfer Model for Complex Land Surface Cloud Detection[J].ACTA ELECTRONICA SINICA,2022,50(04):932-942.
邓梦娇,徐新,马盈盈等.多层感知机结合辐射传输模型的复杂陆地表面云检测[J].电子学报,2022,50(04):932-942. DOI： 10.12263/DZXB.20210636.

DENG Meng-jiao,XU Xin,MA Ying-ying,et al.Multi-layer Perceptron Combined with Radiative Transfer Model for Complex Land Surface Cloud Detection[J].ACTA ELECTRONICA SINICA,2022,50(04):932-942. DOI： 10.12263/DZXB.20210636.

摘要

云检测是卫星遥感数据预处理中至关重要的工作.本文将多层感知机和辐射传输模型相结合，利用可见光和近红外波段反射率信息从卫星影像中识别出云像元.该方法利用SBDART辐射传输模型，模拟获得了各种复杂陆地地表的反射率值数据集，为多层感知机提供训练样本.随后，用训练好的多层感知机模型区分FY-3D卫星MERSI II影像中的云像元和非云像元，利用CALIPSO垂直特性掩膜产品（Vertical Feature Mask，VFM）逐像元进行验证，并与MODIS云掩膜产品（MYD35）进行横向对比.结果表明，以VFM数据集为标准的情况下，多层感知机识别云的总正确率为76.25%，其中在夏季和低纬度地区效果最好，如赤道附近地表识别的准确率可达到91.74%，而在城市、农田和裸地等复杂地表类型条件下的云检测识别正确率分别为83.37%、84.52%和73.11%，分别高于MYD35产品的83.25%、83.31%和72.66%.为了进一步验证多层感知机结合辐射传输模型云检测方法的有效性，将辐射传输模型模拟得到的训练样本分别用于k-最近邻、朴素贝叶斯以及随机森林算法，并与本文多层感知机算法进行对比.结果表明，将多层感知机和辐射传输模型相结合具有更高的正确率.

Abstract

Cloud detection is a key step in the preprocessing of satellite remote sensing data. This paper proposes a cloud detection method by combining a multilayer perceptron with a radiative transfer model. The method is to identify cloud from moderate resolution satellite image using visible and near-infrared band reflectance information. In this method

firstly

the santa barbara DISORT atmospheric radiative transfer model(SBDART) is used to simulate and obtain datasets of reflectance values for a variety of complex terrestrial surfaces

which provides training samples for the multilayer perceptron. Secondly

the trained network model is used to distinguish cloud pixels from total pixels of the advanced medium Resolution Spectral Imager(MERSI II) image in the FengYun3D satellite MERSI II image

and then verified using vertical feature mask(VFM) product of the cloud-aerosol LIDAR infrared pathfinder satellite observations satellite(CALIPSO) and compared horizontally with the cloud mask product(MYD35) of the moderate resolution imaging spectroradiometer(MODIS). The results show that the accuracy of cloud detection for the multilayer perceptron is 76.25%

and especially this method works best in summer and low latitudes

achieves an accuracy of 91.74% for surface identification near the equator. In this paper

the method is more effective in detecting clouds under complex surface type conditions such as urban

farmland and bare soil

with accuracies of 83.37%

84.52% and 73.11% respectively

which are higher than the 83.25%

83.31% and 72.66% of the MYD35 product respectively. To further validate the effectiveness of the multilayer perceptron combined with the radiative transfer model

the training samples obtained from the radiative transfer model simulations are used in the k-nearest neighbors

Naive Bayesian

and Random Forest algorithms

respectively

and compared with the multilayer perceptron algorithm in this paper. The results show that the combination of the multilayer perceptron and the radiative transfer model has a higher accuracy.

关键词

Keywords

references

ZHU Z , WOODCOCK C E . Object-based cloud and cloud shadow detection in Landsat imagery [J]. Remote Sensing of Environment , 2012 , 118 : 83 - 94 .

JIN S , ZHANG M , MA Y , et al . Adapting the dark target algorithm to advanced MERSI sensor on the FengYun-3-D satellite: Retrieval and Validation of Aerosol Optical Depth Over Land [J]. IEEE Transactions on Geoscience and Remote Sensing , 2021 , 59 ( 10 ): 8781 - 8797 .

胡根生 , 查慧敏 , 梁栋 , 等 . 结合分类与迁移学习的薄云覆盖遥感图像地物信息恢复 [J]. 电子学报 , 2017 , 45 ( 12 ): 2855 - 2862 .

HU G S , ZHA H M , LIANG D , et al . Ground object information recovery for thin cloud contaminated remote sensing images by combining classification with transfer learning [J]. Acta Electronica Sinica , 2017 , 45 ( 12 ): 2855 - 2862 . (in Chinese)

JEDLOVEC G J , HAINES S L , LAFONTAINE F J . Spatial and temporal varying thresholds for cloud detection in GOES imagery [J]. IEEE Transactions on Geoscience and Remote Sensing , 2008 , 46 ( 6 ): 1705 - 1717 .

HAGOLLE O , HUC M , PASCUAL D V , et al . A multi-temporal method for cloud detection, applied to FORMOSAT-2, VEN <math id="M17"><mi mathvariant="normal">μ</mi></math> http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=39122475&type= http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=39122469&type= 1.69333339 2.96333337 S, LANDSAT and SENTINEL-2 images [J]. Remote Sensing of Environment , 2010 , 114 ( 8 ): 1747 - 1755 .

SAUNDERS R W , KRIEBEL K T . An improved method for detecting clear sky and cloudy radiances from AVHRR data [J]. International Journal of Remote Sensing , 1988 , 9 ( 1 ): 123 - 150 .

K-T KRIEBEL , GESELL G , STNER M KA , et al . The cloud analysis tool APOLLO: Improvements and validations [J]. International Journal of Remote Sensing , 2003 , 24 ( 12 ): 2389 - 2408 .

WEI J , HUANG W , LI Z Q , et al . Cloud detection for Landsat imagery by combining the random forest and superpixels extracted via energy-driven sampling segmentation approaches [J]. Remote Sensing of Environment , 2020 , 248 : 1 - 14 .

LI Y , CHEN W , ZHANG Y , et al . Accurate cloud detection in high-resolution remote sensing imagery by weakly supervised deep learning [J]. Remote Sensing of Environment , 2020 , 250 : 1 - 18 .

YANG Z , ZHANG P , GU S , et al . Capability of Fengyun-3D satellite in earth system observation [J]. Journal of Meteorological Research , 2019 , 33 ( 6 ): 1113 - 1130 .

ROSSOW W B , GARDER L C . Cloud detection using satellite measurements of infrared and visible radiances for ISCCP [J]. Journal of Climate , 1993 , 6 ( 12 ): 2341 - 2369 .

IRISH R R . Landsat 7 automatic cloud cover assessment [C]// Algorithms for Multispectral, Hyperspectral, and Ultraspectral Imagery VI . Orlando : International Society for Optics and Photonics , 2000 : 348 - 355 .

IRISH R R , BARKER J L , GOWARD S N , et al . Characterization of the Landsat-7 ETM+ automated cloud-cover assessment (ACCA) algorithm [J]. Photogrammetric Engineering & Remote Sensing , 2006 , 72 ( 10 ): 1179 - 1188 .

ACKERMAN S A , STRABALA K I , MENZEL W P , et al . Discriminating clear sky from clouds with MODIS [J]. Journal of Geophysical Research: Atmospheres , 1998 , 103 ( D24 ): 32141 - 32157 .

SUN L , WEI J , WANG J , et al . A universal dynamic threshold cloud detection algorithm(UDTCDA) supported by a prior surface reflectance database [J]. Journal of Geophysical Research: Atmospheres , 2016 , 121 ( 12 ): 7172 - 7196 .

VERMOTE E F , TANRÉ D , DEUZE J L , et al . Second simulation of the satellite signal in the solar spectrum, 6S: an overview [J]. IEEE Transactions on Geoscience and Remote Sensing , 1997 , 35 ( 3 ): 675 - 686 .

VERMOTE E , TANRÉ D , DEUZÉ J L , et al . Second simulation of a satellite signal in the solar spectrum-vector (6SV) [J]. 6S User Guide Version , 2006 , 3 ( 2 ): 1 - 55 .

WANG H , HE Y , GUAN H . Application of support vector machines in cloud detection using EOS/MODIS [C]// Remote Sensing Applications for Aviation Weather Hazard Detection and Decision Support . San Diego : International Society for Optics and Photonics , 2008 : 1 - 8 .

MENG F , YANG X , ZHOU C , et al . A sparse dictionary learning-based adaptive patch inpainting method for thick clouds removal from high-spatial resolution remote sensing imagery [J]. Sensors , 2017 , 17 ( 9 ): 1 - 16 .

徐少平 , 林珍玉 , 张贵珍 , 等 . 采用深度学习与图像融合混合实现策略的低照度图像增强算法 [J]. 电子学报 , 2021 , 49 ( 1 ): 72 - 76 .

XU S P , LIN Z Y , ZHANG G Z , et al . A low-light image enhancement algorithm using the hybrid strategy of deep learning and image fusion [J]. Acta Electronica Sinica , 2021 , 49 ( 1 ): 72 - 76 . (in Chinese)

周涛 , 霍兵强 , 陆惠玲 , 等 . 残差神经网络及其在医学图像处理中的应用研究 [J]. 电子学报 , 2020 , 48 ( 7 ): 1436 - 1447 .

ZHOU T , HUO B Q , LU H L , et al . Research on residual neural network and its application on medical image processing [J]. Acta Electronica Sinica , 2020 , 48 ( 7 ): 1436 - 1447 . (in Chinese)

刘启超 , 肖亮 , 刘芳 , 等 . SSCDenseNet: 一种空-谱卷积稠密网络的高光谱图像分类算法 [J]. 电子学报 , 2020 , 48 ( 4 ): 751 - 762 .

LIU Q C , XIAO L , LIU F , et al . SSCDenseNet: A spectral-spatial convolutional dense network for hyperspectral image classification [J]. Acta Electronica Sinica , 2020 , 48 ( 4 ): 751 - 762 . (in Chinese)

XIE F , SHI M , SHI Z , et al . Multilevel cloud detection in remote sensing images based on deep learning [J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing , 2017 , 10 ( 8 ): 3631 - 3640 .

SEGAL-ROZENHAIMER M , LI A , DAS K , et al . Cloud detection algorithm for multi-modal satellite imagery using convolutional neural-networks(CNN) [J]. Remote Sensing of Environment , 2020 , 237 : 1 - 17 .

LONG J , SHELHAMER E , DARRELL T . Fully convolutional networks for semantic segmentation [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Boston : IEEE , 2015 : 3431 - 3440 .

CHAI D , NEWSAM S , ZHANG H K , et al . Cloud and cloud shadow detection in Landsat imagery based on deep convolutional neural networks [J]. Remote Sensing of Environment , 2019 , 225 : 307 - 316 .

MATEO-GARCÍA G , LAPARRA V , LÓPEZ-PUIGDOLLERS D , et al . Transferring deep learning models for cloud detection between Landsat-8 and Proba-V [J]. ISPRS Journal of Photogrammetry and Remote Sensing , 2020 , 160 : 1 - 17 .

LI Z , SHEN H , CHENG Q , et al . Deep learning based cloud detection for medium and high resolution remote sensing images of different sensors [J]. ISPRS Journal of Photogrammetry and Remote Sensing , 2019 , 150 : 197 - 212 .

WIELAND M , LI Y , MARTINIS S . Multi-sensor cloud and cloud shadow segmentation with a convolutional neural network [J]. Remote Sensing of Environment , 2019 , 230 : 1 - 12 .

YANG J , GUO J , YUE H , et al . CDnet: CNN-based cloud detection for remote sensing imagery [J]. IEEE Transactions on Geoscience and Remote Sensing , 2019 , 57 ( 8 ): 6195 - 6211 .

LUOTAMO M , METSÄMÄKI S , KLAMI A . Multiscale cloud detection in remote sensing images using a dual convolutional neural network [J]. IEEE Transactions on Geoscience and Remote Sensing , 2020 , 59 ( 6 ): 4972 - 4983 .

RICCHIAZZI P , YANG S , GAUTIER C , et al . SBDART: a research and teaching software tool for plane-parallel radiative transfer in the earth's atmosphere [J]. Bulletin of the American Meteorological Society , 1998 , 79 ( 10 ): 2101 - 2114 .

STAMNES K , HAMRE B , STAMNES J J , et al . Modeling of radiation transport in coupled atmosphere-snow-ice-ocean systems [J]. Journal of Quantitative Spectroscopy and Radiative Transfer , 2011 , 112 ( 4 ): 714 - 726 .

ATKINSON P M , TATNALL A R L . Introduction neural networks in remote sensing [J]. International Journal of Remote Sensing , 1997 , 18 ( 4 ): 699 - 709 .

HE T , DONG Z , MENG K , et al . Accelerating multi-layer perceptron based short term demand forecasting using graphics processing units [C]// Proceedings of the 2009 Transmission & Distribution Conference & Exposition: Asia and Pacific . Seoul : IEEE , 2009 : 1 - 4 .

任进军 , 王宁 . 人工神经网络中损失函数的研究 [J]. 甘肃高师学报 , 2018 , 23 ( 2 ): 61 - 63 .

REN J J , WANG N . Research on cost function in artificial neural network [J]. Journal of Gansu Normal Colleges , 2018 , 23 ( 2 ): 61 - 63 . (in Chinese)

XU N , NIU X , HU X , et al . Prelaunch calibration and radiometric performance of the advanced MERSI II on FengYun-3D [J]. IEEE Transactions on Geoscience and Remote Sensing , 2018 , 56 ( 8 ): 4866 - 4875 .

SALOMONSON V V , BARNES W , MASUOKA E J . Introduction to MODIS and An Overview of Associated Activities [M]. Berlin : Springer , 2006 : 12 - 32 .

GAO B C , GOETZ A F H , WISCOMBE W J . Cirrus cloud detection from airborne imaging spectrometer data using the 1.38 μm water vapor band [J]. Geophysical Research Letters , 1993 , 20 ( 4 ): 301 - 304 .

GUO G , WANG H , BELL D , et al . KNN model-based approach in classification [C]// On The Move to Meaningful Internet Systems Confederated International Conferences . Berlin : Springer , 2003 : 986 - 996 .

SUCAR L E . Probabilistic Graphical Models [M]. Berlin : Springer , 2021 : 43 - 69 .

PARMAR A , KATARIYA R , PATEL V . A review on random forest: An ensemble classifier [C]// International Conference on Intelligent Data Communication Technologies and Internet of Things . Coimbatore : Springer , 2018 : 1 - 6 .

ZHU Y , MA Y , LIU B , et al . Retrieving the vertical distribution of PM2.5 mass concentration from lidar via a random forest Model [J]. IEEE Transactions on Geoscience and Remote Sensing , 2021 , 60 : 1 - 9 .

陈喆 , 贾春福 , 宗楠 , 等 . 随机森林在程序分支混淆中的应用 [J]. 电子学报 , 2018 , 46 ( 10 ): 2458 - 2466 .

CHEN Z , JIN C F , ZONG N , et al . Branch obfuscation using random forest [J]. Acta Electronica Sinica , 2018 , 46 ( 10 ): 2458 - 2466 . (in Chinese)

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

The Pi-Sigma Network Learning from Numerical Patterns and Fuzzy Rules

Related Author

孙怀江

孙进才

倪昌祥

Related Institution

.O. BOx 19,Northwestern Polytechnical University,Xi’ an 710072) Ni Changxang

⁰