基于自编码器和超图的半监督宽度学习系统

王雪松; 张翰林; 程玉虎

doi:10.12263/DZXB.20210105

您当前的位置：

首页 >

文章列表页 >

基于自编码器和超图的半监督宽度学习系统

学术论文 | 更新时间：2025-12-11

- 基于自编码器和超图的半监督宽度学习系统
- Autoencoder and Hypergraph-Based Semi-Supervised Broad Learning System
- 电子学报 2022年50卷第3期页码：533-539
- 作者机构：
  
  1.地下空间智能控制教育部工程研究中心, 江苏徐州 221116
  2.中国矿业大学信息与控制工程学院, 江苏徐州 221116
- 作者简介：
  
  [ "王雪松女，1974年生，安徽泗县人.现为地下空间智能控制教育部工程研究中心主任，中国矿业大学信息与控制工程学院教授、博士生导师.研究领域为机器学习及模式识别.E-mail:wangxuesongcumt@163.com" ]
  [ "张翰林男，1998年生，山东聊城人.现为中国矿业大学信息与控制工程学院硕士研究生.研究领域为图像处理与分析.E-mail:18252111368@163.com" ]
  [ "程玉虎（通讯作者）男，1973年生，安徽淮南人.现为中国矿业大学信息与控制工程学院教授、博士生导师.研究领域为机器学习及模式识别." ]
- 基金信息：
  
  国家自然科学基金(61976215;62176259)
- DOI：10.12263/DZXB.20210105
  中图分类号： TP181
- 收稿：2021-01-13，
  
  修回：2021-03-17，
  
  纸质出版：2022-03-25
- 稿件说明：
移动端阅览
王雪松,张翰林,程玉虎.基于自编码器和超图的半监督宽度学习系统[J].电子学报,2022,50(03):533-539.

WANG Xue-song,ZHANG Han-lin,CHENG Yu-hu.Autoencoder and Hypergraph-Based Semi-Supervised Broad Learning System[J].ACTA ELECTRONICA SINICA,2022,50(03):533-539.
王雪松,张翰林,程玉虎.基于自编码器和超图的半监督宽度学习系统[J].电子学报,2022,50(03):533-539. DOI： 10.12263/DZXB.20210105.

WANG Xue-song,ZHANG Han-lin,CHENG Yu-hu.Autoencoder and Hypergraph-Based Semi-Supervised Broad Learning System[J].ACTA ELECTRONICA SINICA,2022,50(03):533-539. DOI： 10.12263/DZXB.20210105.

摘要

常规宽度学习系统（Broad Learning System

BLS）通常采用的线性稀疏特征提取方法难以对数据的复杂非线性特征进行有效表征.此外，当标记样本量较少时，BLS的泛化性能难以得到保证.为此，提出一种基于自编码器和超图的半监督宽度学习系统（Autoencoder and Hypergraph-based Semi-supervised BLS

AH-SBLS）.主要步骤为：首先，使用包括标记样本和无标记样本在内的全部样本训练自编码器，利用训练好的自编码器自动提取数据的复杂非线性特征；其次，将自编码器特征层中的特征作为AH-SBLS的特征节点并对其进行宽度拓展；然后，构造半监督超图以挖掘标记样本和无标记样本间的高阶流形关系，并将超图正则项引入宽度学习系统的目标函数中；最后，利用岭回归对目标函数进行求解，实现对无标记样本的类别预测.在图像分类实验上的结果表明，AH-SBLS能够实现半监督分类且获得较高的分类精度.

Abstract

The linear sparse feature extraction method used in the classical broad learning system(BLS) is difficult to extract the complex nonlinear features of data effectively. In addition

when the number of labeled samples is small

the generalization ability of BLS cannot be guaranteed. To solve these problems

a novel autoencoder and hypergraph-based semi-supervised BLS(AH-SBLS) is proposed. The main steps of AH-SBLS are described as follows. Firstly

we use all labeled and unlabeled samples to train the autoencoder

and then the trained autoencoder is used to extract the features of input data automatically. Secondly

the extracted features are viewed as the feature nodes of AH-SBLS and are further broadened. In the third step

a semi-supervised hypergraph is constructed to express the high-order manifold relationship between labeled and unlabeled samples

and the hypergraph regularization term is introduced into the objective function of AH-SBLS. Finally

the objective function of AH-SBLS is solved by ridge regression and thus the labels of unlabeled samples can be predicted. Experimental results of image classification show that AH-SBLS can achieve higher classification accuracy in semi-supervised classification tasks.

关键词

Keywords

references

CHEN C L P , LIU Z . Broad learning system: an effective and efficient incremental learning system without the need for deep architecture [J]. IEEE Transactions on Neural Networks and Learning Systems , 2018 , 29 ( 99 ): 10 ⁃ 24 .

SUI S , CHEN C L P , TONG S , FENG S . Finite-time adaptive quantized control of stochastic nonlinear systems with input quantization: a broad learning system based identification method [J]. IEEE Transactions on Industrial Electronics , 2020 , 67 ( 10 ): 8555 ⁃ 8565 .

CHU F , LIANG T , CHEN C L P , WANG X , MA X . Weighted broad learning system and its application in nonlinear industrial process modeling [J]. IEEE Transactions on Neural Networks and Learning Systems , 2020 , 31 ( 8 ): 3017 ⁃ 3031 .

HAN M , LI W , FENG S , QIU T , CHEN C L P . Maximum information exploitation using broad learning system for large-scale chaotic time-series prediction [J]. IEEE Transactions on Neural Networks and Learning Systems , 2021 , 32 ( 6 ): 2320 ⁃ 2329 .

KONG Y , WANG X , CHENG Y , CHEN C L P . Hyperspectral imagery classification based on semi-supervised broad learning system [J]. Remote Sensing , 2018 , 10 ( 5 ): 685 .

SHAO Y , SANG N , GAO C , MA L . Spatial and class structure regularized sparse representation graph for semi-supervised hyperspectral image classification [J]. Pattern Recognition , 2018 , 81 : 81 ⁃ 94 .

ZHAO H , ZHENG J , DENG W , SONG Y . Semi-supervised broad learning system based on manifold regularization and broad network [J]. IEEE Transactions on Circuits and Systems I: Regular Papers , 2020 , 67 ( 3 ): 983 ⁃ 994 .

BELKIN M , NIYOGI P , SINDHWANI V . Manifold regularization: a geometric framework for learning from labeled and unlabeled examples [J]. Journal of Machine Learning Research , 2006 , 7 : 2399 ⁃ 2434 .

ANIS A , EL G A , AVESTIMEHR A S , ORTEGA A . A sampling theory perspective of graph-based semi-supervised learning [J]. IEEE Transactions on Information Theory , 2019 , 65 ( 4 ): 2322 ⁃ 2342 .

冀中 , 樊帅飞 . 基于超图排序算法的视频摘要 [J]. 电子学报 , 2017 , 45 ( 5 ): 1035 ⁃ 1043 .

JI Zhong , FAN Shuai-fei . Video summarization based on hypergraph ranking [J]. Acta Electronica Sinica , 2017 , 45 ( 5 ): 1035 ⁃ 1043 . (in Chinese)

HINTON G E , SALAKHUTDINOV R . Reducing the dimensionality of data with neural networks [J]. Science , 2006 , 313 ( 5786 ): 504 ⁃ 507 .

高妮 , 高岭 , 贺毅岳 , 王海 . 基于自编码网络特征降维的轻量级入侵检测模型 [J]. 电子学报 , 2017 , 45 ( 3 ): 730 ⁃ 739 .

GAO Ni , GAO Ling , HE Yi-yue , WANG Hai . A lightweight intrusion detection model based on autoencoder network with feature reduction [J]. Acta Electronica Sinica , 2017 , 45 ( 3 ): 730 ⁃ 739 . (in Chinese)

翟颖 , 陈渤 . 基于稳健变分自编码模型的雷达高分辨距离像目标识别算法 [J]. 电子学报 , 2020 , 48 ( 6 ): 1149 ⁃ 1155 .

ZHAI Ying , CHEN Bo . Study of radar high range resolution profiles target recognition based on auto-encoder [J]. Acta Electronica Sinica , 2020 , 48 ( 6 ): 1149 ⁃ 1155 . (in Chinese)

李东瑾 , 杨瑞娟 , 李晓柏 , 董睿杰 . 基于栈式稀疏降噪自编码网络的辐射源调制识别 [J]. 电子学报 , 2020 , 48 ( 6 ): 1198 ⁃ 1204 .

LI Dong-jin , YANG Rui-juan , LI Xiao-bo , DONG Rui-jie . Emitter signal modulation recognition based on stacked sparse denoising auto-encoders [J]. Acta Electronica Sinica , 2020 , 48 ( 6 ): 1198 ⁃ 1204 . (in Chinese)

RUMMELHART D E , HINTON G E , WILLIAMS R J . Learning internal representations by error propagation [J]. Readings in Cognitive Science , 1988 , 323 ( 2 ): 399 ⁃ 421 .

QIU D , ZHENG L , ZHU J , et al . Multiple improved residual networks for medical image super-resolution [J]. Future Generation Computer Systems , 2021 : 200 ⁃ 208 .

LECUN Y , BOTTOU L . Gradient-based learning applied to document recognition [J]. Proceedings of the IEEE , 1998 , 86 ( 11 ): 2278 ⁃ 2324 .

LECUN Y , HUANG F J , BOTTOU L . Learning methods for generic object recognition with invariance to pose and lighting [C]// Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition , CVPR 2004 . Washington, DC, USA : IEEE , 2004: 97 ⁃ 104 .

VINCENT P , LAROCHELLE H , BENGIO Y , MANZAGOL P A . Extracting and composing robust features with denoising autoencoders [C]// Proceedings of the 25th International Conference on Machine Learning . New York : Academic Press , 2008 : 1096 ⁃ 1103 .

HINTON G E , OSINDERO S , TEH Y W . A fast learning algorithm for deep belief nets [J]. Neural Computation , 2006 , 18 ( 7 ): 1527 ⁃ 1554 .

SALAKHUTDINOV R , HINTON G E . Deep boltzmann machines [J]. Journal of Machine Learning Research , 2009 , 5 ( 2 ): 1967 ⁃ 2006 .

HAN X , GHAEMI M S , ANDO K , PETERSON L S , GAUDILLIERE B , et al . Differential dynamics of the maternal immune system in healthy pregnancy and preeclampsia [J]. Frontiers in Immunology , 2019 , 10 : 1305 . DOI: 10.3389/fimmu.2019.01305 http://dx.doi.org/10.3389/fimmu.2019.01305 .

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

背景感知机制的图像分类网络

基于坐标重要性池化和解耦类别对齐蒸馏的图像分类算法

基于特征异常检测与伪标签回归的无监督对抗域适应

基于自编码器和隔离森林的水处理系统递进式异常检测方法

基于图表征知识蒸馏的图像分类方法