Semi-Supervised Feature Selection with Adaptive Graph Learning

JIANG Bing-bing; HE Wen-da; WU Xing-yu; XIANG Jun-hao; HONG Li-bin; SHENG Wei-guo

doi:10.12263/DZXB.20210415

您当前的位置：

首页 >

文章列表页 >

Semi-Supervised Feature Selection with Adaptive Graph Learning

PAPERS | 更新时间：2025-12-08

- Semi-Supervised Feature Selection with Adaptive Graph Learning
- ACTA ELECTRONICA SINICA Vol. 50, Issue 7, Pages: 1643-1652(2022)
- 作者机构：
  
  1.杭州师范大学信息科学与技术学院，浙江杭州 311121
  2.中国科学技术大学计算机科学与技术学院，安徽合肥 230027
- 作者简介：
- 基金信息：
- DOI：10.12263/DZXB.20210415
  CLC： TP391.4;
- Received：30 March 2021，
  
  Revised：2021-11-25，
  
  Published：25 July 2022
- 稿件说明：
移动端阅览
江兵兵,何文达,吴兴宇等.基于自适应图学习的半监督特征选择[J].电子学报,2022,50(07):1643-1652.

JIANG Bing-bing,HE Wen-da,WU Xing-yu,et al.Semi-Supervised Feature Selection with Adaptive Graph Learning[J].ACTA ELECTRONICA SINICA,2022,50(07):1643-1652.
江兵兵,何文达,吴兴宇等.基于自适应图学习的半监督特征选择[J].电子学报,2022,50(07):1643-1652. DOI： 10.12263/DZXB.20210415.

JIANG Bing-bing,HE Wen-da,WU Xing-yu,et al.Semi-Supervised Feature Selection with Adaptive Graph Learning[J].ACTA ELECTRONICA SINICA,2022,50(07):1643-1652. DOI： 10.12263/DZXB.20210415.

摘要

随着数据特征维数的增加，如何在少量有标签和大量无标签高维样本的情况下选择相关的特征子集已成为特征选择领域的热点问题.针对现有半监督特征选择算法直接忽略特征选择与局部结构学习之间的相互作用，从而难以有效获取样本分布结构的问题，本文提出了一种基于自适应图学习的半监督特征选择（Semi-supervised Feature Selection with Adaptive Graph learning，SFSAG）算法.利用标签传播将特征空间的稀疏投影学习和近邻图的构建有效地结合起来，实现在选择相关特征的同时还能学习样本的局部结构；自适应地利用样本在投影特征空间中的相似性信息构建可靠的近邻图，从而有效降低噪声特征的干扰并选择更具判别性的特征子集.多种数据集上的实验验证了SFSAG的有效性及其相对于现有半监督特征选择算法的优越性.

Abstract

With the increasing feature dimensionality

how to select a relevant feature subset in the case of a few labeled and large amount of unlabeled high-dimensional samples has become a hot issue in feature selection. However

existing semi-supervised feature selection algorithms directly ignore the interaction between feature selection and local structure learning

making it difficult to obtain the distribution structure information. To these ends

a semi-supervised feature selection algorithm with adaptive graph learning(SFSAG) is developed in this paper. Firstly

the label propagation is used to link the tasks of sparse projection learning on the original feature space and construction of affinity graph

such that the feature selection and local structure learning can be performed simultaneously. Then

a reliable neighbor graph is adaptively constructed by using the similarity information of samples in the projected feature space

which largely alleviates the adverse effects of noisy dimensions and facilitates selecting more discriminative features. Extensive experiments are conducted on various datasets

and the results demonstrate the effectiveness of the proposed SFSAG and its superiority in comparison with the state-of-the-art feature selection algorithms.

关键词

Keywords

references

LI H F , JIANG T , ZHANG K S . Efficient and robust feature extraction by maximum margin criterion [J]. IEEE Transactions on Neural Networks , 2006 , 17 ( 1 ): 157 - 165 .

蒋盛益 , 郑琪 , 张倩生 . 基于聚类的特征选择方法 [J]. 电子学报 , 2008 , 36 ( S1 ): 157 - 160 .

JIANG S Y , ZHENG Q , ZHANG Q S . Clustering-based feature selection [J]. Acta Electronica Sinica , 2008 , 36 ( S1 ): 157 - 160 . (in Chinese)

SONG X N , ZANG J G , HAN Y H , et al . Semi-supervised feature selection via hierarchical regression for web image classification [J]. Multimedia Systems , 2016 , 22 ( 1 ): 41 - 49 .

刘艳芳 , 李文斌 , 高阳 . 基于自适应邻域嵌入的无监督特征选择算法 [J]. 计算机研究与发展 , 2020 , 57 ( 8 ): 1639 - 1649 .

LIU Y F , LI W B , GAO Y . Adaptive neighborhood embedding based unsupervised feature selection [J]. Journal of Computer Research and Development , 2020 , 57 ( 8 ): 1639 - 1649 . (in Chinese)

SHEIKHPOUR R , SARRAM M A , GHARAGHANI S , et al . A Survey on semi-supervised feature selection methods [J]. Pattern Recognition , 2017 , 64 : 141 - 158 .

ZHAO H F , LI Q , WANG Z , et al . Joint adaptive graph learning and discriminative analysis for unsupervised feature selection [J]. Cognitive Computation , 2021 : 1 - 11 .

余游 , 冯林 , 王格格 , 等 . 一种基于伪标签的半监督少样本学习模型 [J]. 电子学报 , 2019 , 47 ( 11 ): 2284 - 2291 .

YU Y , FENG L , WANG G G , et al . A few-shot learning model based on semi-supervised with pseudo label [J]. Acta Electronica Sinica , 2019 , 47 ( 11 ): 2284 - 2291 . (in Chinese)

ZHAO J D , LU K , HE X F . Locality sensitive semi-supervised feature selection [J]. Neurocomputing , 2008 , 71 ( 10/11/12 ): 1842 - 1849 .

LIU Y , NIE F P , WU J G , et al . Efficient semi-supervised feature selection with noise insensitive trace ratio criterion [J]. Neurocomputing , 2013 , 105 : 12 - 18 .

CHANG X J , NIE F P , YANG Y , et al . A convex formulation for semi-supervised multi-label feature selection [C]// Proceedings of the 28th AAAI Conference on Artificial Intelligence . Québec City : AAAI Press , 2014 : 1171 - 1177 .

CHEN X J , YUAN G W , NIE F P , et al . Semi-supervised feature selection via rescaled linear regression [C]// Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence . Melbourne : IJCAI , 2017 : 1525 - 1531 .

BELKIN M , NIYOGI P , SINDHWANI V . Manifold regularization: A geometric framework for learning from labeled and unlabeled examples [J]. Journal of Machine Learning Research , 2006 , 7 : 2399 - 2434 .

MA Z G , NIE F P , YANG Y , et al . Discriminating joint feature analysis for multimedia data understanding [J]. IEEE Transactions on Multimedia , 2012 , 14 ( 6 ): 1662 - 1672 .

LUO T J , HOU C P , NIE F P , et al . Semi-supervised feature selection via insensitive sparse regression with application to video semantic recognition [J]. IEEE Transactions on Knowledge and Data Engineering , 2018 , 30 ( 10 ): 1943 - 1956 .

SHEIKHPOUR R , SARRAM M A , GHARAGHANI S , et al . A robust graph-based semi-supervised sparse feature selection method [J]. Information Sciences , 2020 , 531 : 13 - 30 .

NIE F P , ZHU W , LI X L . Structured graph optimization for unsupervised feature selection [J]. IEEE Transactions on Knowledge and Data Engineering , 2021 , 33 ( 3 ): 1210 - 1222 .

ZHANG Z , ZHAO M B , CHOW T W S . Graph based constrained semi-supervised learning framework via label propagation over adaptive neighborhood [J]. IEEE Transactions on Knowledge and Data Engineering , 2015 , 27 ( 9 ): 2362 - 2376 .

JIANG B B , WU X Y , YU K , et al . Joint semi-supervised feature selection and classification through Bayesian approach [J]. Proceedings of the AAAI Conference on Artificial Intelligence , 2019 , 33 ( 1 ): 3983 - 3990 .

陈兵飞 , 江兵兵 , 周熙人 , 等 . 基于稀疏贝叶斯的流形学习 [J]. 电子学报 , 2018 , 46 ( 1 ): 98 - 103 .

CHEN B F , JIANG B B , ZHOU X R , et al . Manifold learning based on sparse Bayesian approach [J]. Acta Electronica Sinica , 2018 , 46 ( 1 ): 98 - 103 . (in Chinese)

NIE F P , WANG X Q , HUANG H . Clustering and projected clustering with adaptive neighbors [C]// Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining . New York : ACM , 2014 : 977 - 986 .

XU Y Y , WANG J , AN S , et al . Semi-supervised multi-label feature selection by preserving feature-label space consistency [C]// Proceedings of the 27th ACM International Conference on Information and Knowledge Management . Torino : ACM , 2018 : 783 - 792 .

HUANG J , NIE F P , HUANG H . A new simplex sparse learning model to measure data similarity for clustering [C]// Proceedings of the 24th International Joint Conference on Artificial Intelligence . Buenos Aires : AAAI Press , 2015 : 3569 - 3575

HOU C P , NIE F P , TAO H , et al . Multi-view unsupervised feature selection with adaptive similarity and view weight [J]. IEEE Transactions on Knowledge and Data Engineering , 2017 , 29 ( 9 ): 1998 - 2011 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Comprehensive Causality Multi-Objective Counterfactual Explanation with Feature Selection

Semi-Supervised Medical Image Segmentation Based on Suspicious Pixel Mutual Correction

Robust Unsupervised Feature Selection with Double Fuzzy Learning

Estimation of Signal-to-Noise Ratio Based on Feature Selection and Weight Optimization of High-Order Moments

Related Author

Bing-bing JIANG

Wen-da HE

Xing-yu WU

Jun-hao XIANG

Li-bin HONG

Wei-guo SHENG

LIU Jin-ping

TANG Hao-nan

Related Institution

School of Information Science and Technology， Hangzhou Normal University

School of Computer Science and Technology， University of Science and Technology

College of Information Science and Engineering, Hunan Normal University

School of Electronic Information and Artificial Intelligence, Shaanxi University of Science and Technology

Shaanxi Joint Laboratory of Artificial Intelligence, Shaanxi University of Science and Technology

⁰