基于自适应图学习的半监督特征选择

江兵兵; 何文达; 吴兴宇; 项俊浩; 洪立斌; 盛伟国

doi:10.12263/DZXB.20210415

您当前的位置：

首页 >

文章列表页 >

基于自适应图学习的半监督特征选择

学术论文 | 更新时间：2025-12-08

- 基于自适应图学习的半监督特征选择
- Semi-Supervised Feature Selection with Adaptive Graph Learning
- 电子学报 2022年50卷第7期页码：1643-1652
- 作者机构：
  
  1.杭州师范大学信息科学与技术学院，浙江杭州 311121
  2.中国科学技术大学计算机科学与技术学院，安徽合肥 230027
- 作者简介：
  
  [ "江兵兵男，1991年生，安徽颍上人.2019年毕业于中国科学技术大学计算机应用技术专业，获工学博士学位.现为杭州师范大学信息科学与技术学院硕士生导师，讲师.主要研究方向为半监督学习、特征选择、多视图学习和贝叶斯学习.E-mail: jiangbb@hznu.edu.cn" ]
  [ "何文达男，1996年生，浙江海盐人.杭州师范大学信息科学与技术学院在读硕士研究生，主要研究方向为半监督学习、特征选择等.E-mail: wendahe1996@stu.hznu.edu.cn" ]
  [ "盛伟国（通讯作者）男，1977年生，浙江瑞安人.2002年毕业于英国诺丁汉大学，获信息技术硕士学位；2005年毕业于英国布鲁耐尔大学，获计算机科学博士学位.现为杭州师范大学信息科学与技术学院教授，博士生导师.主要研究方向为智能算法理论和设计及其在数据挖掘、模式识别和信息安全等.E-mail: weiguouk@hotmail.com" ]
- 基金信息：
  
  国家自然科学基金(62006065;61873082);杭州师范大学科研启动项目(20204003)
- DOI：10.12263/DZXB.20210415
  中图分类号： TP391.4;
- 收稿：2021-03-30，
  
  修回：2021-11-25，
  
  纸质出版：2022-07-25
- 稿件说明：
移动端阅览
江兵兵,何文达,吴兴宇等.基于自适应图学习的半监督特征选择[J].电子学报,2022,50(07):1643-1652.

JIANG Bing-bing,HE Wen-da,WU Xing-yu,et al.Semi-Supervised Feature Selection with Adaptive Graph Learning[J].ACTA ELECTRONICA SINICA,2022,50(07):1643-1652.
江兵兵,何文达,吴兴宇等.基于自适应图学习的半监督特征选择[J].电子学报,2022,50(07):1643-1652. DOI： 10.12263/DZXB.20210415.

JIANG Bing-bing,HE Wen-da,WU Xing-yu,et al.Semi-Supervised Feature Selection with Adaptive Graph Learning[J].ACTA ELECTRONICA SINICA,2022,50(07):1643-1652. DOI： 10.12263/DZXB.20210415.

摘要

随着数据特征维数的增加，如何在少量有标签和大量无标签高维样本的情况下选择相关的特征子集已成为特征选择领域的热点问题.针对现有半监督特征选择算法直接忽略特征选择与局部结构学习之间的相互作用，从而难以有效获取样本分布结构的问题，本文提出了一种基于自适应图学习的半监督特征选择（Semi-supervised Feature Selection with Adaptive Graph learning，SFSAG）算法.利用标签传播将特征空间的稀疏投影学习和近邻图的构建有效地结合起来，实现在选择相关特征的同时还能学习样本的局部结构；自适应地利用样本在投影特征空间中的相似性信息构建可靠的近邻图，从而有效降低噪声特征的干扰并选择更具判别性的特征子集.多种数据集上的实验验证了SFSAG的有效性及其相对于现有半监督特征选择算法的优越性.

Abstract

With the increasing feature dimensionality

how to select a relevant feature subset in the case of a few labeled and large amount of unlabeled high-dimensional samples has become a hot issue in feature selection. However

existing semi-supervised feature selection algorithms directly ignore the interaction between feature selection and local structure learning

making it difficult to obtain the distribution structure information. To these ends

a semi-supervised feature selection algorithm with adaptive graph learning(SFSAG) is developed in this paper. Firstly

the label propagation is used to link the tasks of sparse projection learning on the original feature space and construction of affinity graph

such that the feature selection and local structure learning can be performed simultaneously. Then

a reliable neighbor graph is adaptively constructed by using the similarity information of samples in the projected feature space

which largely alleviates the adverse effects of noisy dimensions and facilitates selecting more discriminative features. Extensive experiments are conducted on various datasets

and the results demonstrate the effectiveness of the proposed SFSAG and its superiority in comparison with the state-of-the-art feature selection algorithms.

关键词

Keywords

references

LI H F , JIANG T , ZHANG K S . Efficient and robust feature extraction by maximum margin criterion [J]. IEEE Transactions on Neural Networks , 2006 , 17 ( 1 ): 157 - 165 .

蒋盛益 , 郑琪 , 张倩生 . 基于聚类的特征选择方法 [J]. 电子学报 , 2008 , 36 ( S1 ): 157 - 160 .

JIANG S Y , ZHENG Q , ZHANG Q S . Clustering-based feature selection [J]. Acta Electronica Sinica , 2008 , 36 ( S1 ): 157 - 160 . (in Chinese)

SONG X N , ZANG J G , HAN Y H , et al . Semi-supervised feature selection via hierarchical regression for web image classification [J]. Multimedia Systems , 2016 , 22 ( 1 ): 41 - 49 .

刘艳芳 , 李文斌 , 高阳 . 基于自适应邻域嵌入的无监督特征选择算法 [J]. 计算机研究与发展 , 2020 , 57 ( 8 ): 1639 - 1649 .

LIU Y F , LI W B , GAO Y . Adaptive neighborhood embedding based unsupervised feature selection [J]. Journal of Computer Research and Development , 2020 , 57 ( 8 ): 1639 - 1649 . (in Chinese)

SHEIKHPOUR R , SARRAM M A , GHARAGHANI S , et al . A Survey on semi-supervised feature selection methods [J]. Pattern Recognition , 2017 , 64 : 141 - 158 .

ZHAO H F , LI Q , WANG Z , et al . Joint adaptive graph learning and discriminative analysis for unsupervised feature selection [J]. Cognitive Computation , 2021 : 1 - 11 .

余游 , 冯林 , 王格格 , 等 . 一种基于伪标签的半监督少样本学习模型 [J]. 电子学报 , 2019 , 47 ( 11 ): 2284 - 2291 .

YU Y , FENG L , WANG G G , et al . A few-shot learning model based on semi-supervised with pseudo label [J]. Acta Electronica Sinica , 2019 , 47 ( 11 ): 2284 - 2291 . (in Chinese)

ZHAO J D , LU K , HE X F . Locality sensitive semi-supervised feature selection [J]. Neurocomputing , 2008 , 71 ( 10/11/12 ): 1842 - 1849 .

LIU Y , NIE F P , WU J G , et al . Efficient semi-supervised feature selection with noise insensitive trace ratio criterion [J]. Neurocomputing , 2013 , 105 : 12 - 18 .

CHANG X J , NIE F P , YANG Y , et al . A convex formulation for semi-supervised multi-label feature selection [C]// Proceedings of the 28th AAAI Conference on Artificial Intelligence . Québec City : AAAI Press , 2014 : 1171 - 1177 .

CHEN X J , YUAN G W , NIE F P , et al . Semi-supervised feature selection via rescaled linear regression [C]// Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence . Melbourne : IJCAI , 2017 : 1525 - 1531 .

BELKIN M , NIYOGI P , SINDHWANI V . Manifold regularization: A geometric framework for learning from labeled and unlabeled examples [J]. Journal of Machine Learning Research , 2006 , 7 : 2399 - 2434 .

MA Z G , NIE F P , YANG Y , et al . Discriminating joint feature analysis for multimedia data understanding [J]. IEEE Transactions on Multimedia , 2012 , 14 ( 6 ): 1662 - 1672 .

LUO T J , HOU C P , NIE F P , et al . Semi-supervised feature selection via insensitive sparse regression with application to video semantic recognition [J]. IEEE Transactions on Knowledge and Data Engineering , 2018 , 30 ( 10 ): 1943 - 1956 .

SHEIKHPOUR R , SARRAM M A , GHARAGHANI S , et al . A robust graph-based semi-supervised sparse feature selection method [J]. Information Sciences , 2020 , 531 : 13 - 30 .

NIE F P , ZHU W , LI X L . Structured graph optimization for unsupervised feature selection [J]. IEEE Transactions on Knowledge and Data Engineering , 2021 , 33 ( 3 ): 1210 - 1222 .

ZHANG Z , ZHAO M B , CHOW T W S . Graph based constrained semi-supervised learning framework via label propagation over adaptive neighborhood [J]. IEEE Transactions on Knowledge and Data Engineering , 2015 , 27 ( 9 ): 2362 - 2376 .

JIANG B B , WU X Y , YU K , et al . Joint semi-supervised feature selection and classification through Bayesian approach [J]. Proceedings of the AAAI Conference on Artificial Intelligence , 2019 , 33 ( 1 ): 3983 - 3990 .

陈兵飞 , 江兵兵 , 周熙人 , 等 . 基于稀疏贝叶斯的流形学习 [J]. 电子学报 , 2018 , 46 ( 1 ): 98 - 103 .

CHEN B F , JIANG B B , ZHOU X R , et al . Manifold learning based on sparse Bayesian approach [J]. Acta Electronica Sinica , 2018 , 46 ( 1 ): 98 - 103 . (in Chinese)

NIE F P , WANG X Q , HUANG H . Clustering and projected clustering with adaptive neighbors [C]// Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining . New York : ACM , 2014 : 977 - 986 .

XU Y Y , WANG J , AN S , et al . Semi-supervised multi-label feature selection by preserving feature-label space consistency [C]// Proceedings of the 27th ACM International Conference on Information and Knowledge Management . Torino : ACM , 2018 : 783 - 792 .

HUANG J , NIE F P , HUANG H . A new simplex sparse learning model to measure data similarity for clustering [C]// Proceedings of the 24th International Joint Conference on Artificial Intelligence . Buenos Aires : AAAI Press , 2015 : 3569 - 3575

HOU C P , NIE F P , TAO H , et al . Multi-view unsupervised feature selection with adaptive similarity and view weight [J]. IEEE Transactions on Knowledge and Data Engineering , 2017 , 29 ( 9 ): 1998 - 2011 .

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

带特征选择的综合因果多目标反事实解释方法

基于可疑像素相互修正的半监督医学图像分割

基于双模糊学习的鲁棒无监督特征选择算法

基于高阶矩特征选择和权值优化的信噪比估计