A Self-Adaption Ensemble Algorithm Based on Random Subspace and AdaBoost

YAO Xu; WANG Xiao-dan; ZHANG Yu-xi; XING Ya-qiong

doi:10.3969/j.issn.0372-2112.2013.04.031

您当前的位置：

首页 >

文章列表页 >

A Self-Adaption Ensemble Algorithm Based on Random Subspace and AdaBoost

更新时间：2025-07-16

- A Self-Adaption Ensemble Algorithm Based on Random Subspace and AdaBoost
- Acta Electronica Sinica Vol. 41, Issue 4, Pages: 810-814(2013)
- 作者机构：
  
  空军工程大学防空反导学院,陕西,西安,710051
- 作者简介：
- 基金信息：
  
  National Natural Science Foundation of China (No.60975026, No.61273275)
- DOI：10.3969/j.issn.0372-2112.2013.04.031
  CLC： TP391.4
- Published：2013
- 稿件说明：
移动端阅览
YAO Xu, WANG Xiao-dan, ZHANG Yu-xi, et al. A Self-Adaption Ensemble Algorithm Based on Random Subspace and AdaBoost[J]. Acta Electronica Sinica, 2013, 41(4): 810-814.
DOI：

YAO Xu, WANG Xiao-dan, ZHANG Yu-xi, et al. A Self-Adaption Ensemble Algorithm Based on Random Subspace and AdaBoost[J]. Acta Electronica Sinica, 2013, 41(4): 810-814. DOI： 10.3969/j.issn.0372-2112.2013.04.031.

摘要

如何构造差异性大且精确度高的基分类器是集成学习的重点

为此提出一种新的集成学习方法——利用PSO寻找使得AdaBoost依样本权重抽取的数据集分类错误率最小化的最优特征权重分布

依据此最优权重分布对特征随机抽样生成随机子空间

并应用于AdaBoost的训练过程中.这就在增加分类器间差异性的同时保证了基分类器的准确度.最后用多数投票法融合各基分类器的决策结果

并通过仿真实验验证该方法的有效性.

Abstract

It is an open issue how to generate base classifiers with higher diversity and accuracy for ensemble learning.In this paper

a novel algorithm is proposed to solve this problem---particle swarm optimization is used to search for an optimal feature weight distribution which makes the classification error rate of training data sample by the distribution in AdaBoost minimal.Then

the feature subspace is constructed according to the optimal feature weight distribution

which is applied into the training process of AdaBoost.Thus

the accuracy of base classifier is advanced;meanwhile

the diversity between classifiers is improved.Finally

majority voting method is utilized to fuse the base classifiers' results and experiments have been done to attest the validity of the proposed algorithm.

关键词

Keywords

references

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Multi-Objective Design Method for Single-Stage Fully Differential Folded Cascode Operational Amplifiers Based on the Artificial Intelligence Algorithm

Manifold Nearest Neighbor Sample Envelope and Hierarchical Multitype Transform Algorithm for Ensemble Learning

An Imbalanced Multi-Label Data Ensemble Learning Method Based on Safe Under-Sampling

Cryptojacking Malware Hunting: A Method Based on Ensemble Learning of Hierarchical Threat Intelligence Feature

Related Author

LI Zhao-xi

SU Zhen-yu

TIAN Yu-hao

HOU Chen-xue

YANG Yin-tang

YAN Fang

MA Jie

LI Yong-ming

Related Institution

Department of Integrated Circuits, Xidian University

School of Microelectronics and Communication Engineering, Chongqing University

Mine Digitization Engineering Research Center of the Ministry of Education

School of Computer Science and Technology, China University of Mining and Technology

Key Laboratory of Aerospace Information Security and Trusted Computing of the Ministry of Education, School of Cyber Science and Engineering, Wuhan University

⁰