基于互信息下粒子群优化的属性约简算法

doi:10.3969/j.issn.0372-2112.2017.11.017

电子学报 ›› 2017, Vol. 45 ›› Issue (11): 2695-2704.DOI: 10.3969/j.issn.0372-2112.2017.11.017

基于互信息下粒子群优化的属性约简算法

续欣莹¹, 张扩¹, 谢珺¹, 谢刚²

1. 太原理工大学, 山西晋中 030060;
2. 太原理工大学国际教育交流学院, 山西太原 030024

收稿日期:2016-01-29 修回日期:2016-06-07 出版日期:2017-11-25
- 作者简介:
- 续欣莹,男,1979出生.副教授,博士,研究方向为粒计算、数据挖掘与计算机视觉.E-mail:xuxinying@tyut.edu.cn;张扩,男,1991出生.硕士研究生,研究方向为机器学习、数据挖掘与智能信息处理.E-mail:zkzk4451@126.com
- 基金资助:
- 人社部留学回国人员科技活动择优资助项目 (No.2013-68）; 山西省自然科学基金 (No.2014011018-2）; 山西省回国留学人员科研资助项目No.2013-033，No.2015-045）

An Attribute Reduction Algorithm Based on Mutual Information of Particle Swarm Optimization

XU Xin-ying¹, ZHANG Kuo¹, XIE Jun¹, XIE Gang²

1. College of Information Engineering, Taiyuan University of Technology, Jinzhong, Shanxi 030060, China;
2. College of International Education and Exchange, Taiyuan University of Technology, Taiyuan, Shanxi 030024, China

Received:2016-01-29 Revised:2016-06-07 Online:2017-11-25 Published:2017-11-25

摘要/Abstract

摘要： 最小属性约简是粗糙集理论中属性约简的优化问题.在寻找最小属性约简的问题上，基于粒子群优化的属性约简算法（ARPSO算法）优于传统的属性约简算法.在现有的ARPSO算法中，正域部分通常被作为启发式信息，但是它并不能够很好地衡量不确定性，而互信息是粗糙集理论中一种更有效的度量不确定信息的重要工具.为此，提出基于互信息下的粒子群优化的属性约简算法（MIPSO算法），该算法把互信息作为适应度函数，通过增强粒子能迅速靠近吸引子的这一特性，改进了内嵌区域震荡搜索的粒子群优化算法（简记为RSPSO算法），防止算法较早的陷入局部最优，使得粒子群中的粒子更快的找到最优值，因此使得算法尽可能实现全局收敛.实验结果表明，该算法不仅提高了寻优的能力，加快了算法的速度，提升了算法的精度，而且也能够使得约简后剩余属性的互信息值与约简前所有属性的互信息值近似相等.

关键词: 互信息, 粒子群优化, 最小属性约简, 粗糙集, 局部搜索模式

Abstract: Minimum attribute reduction is the optimum problem in the attribute reduction of the rough sets theory.To seek the minimum attribute reduction,the attribute reduction algorithm based on the particle swarm optimization (ARPSO algorithm)beats the traditional attribute reduction algorithm.In existed ARPSO algorithms,the positive region is usually taken as the heuristic information,however,it is not precision enough to measure the uncertainty.The mutual information is a more efficient tool to measure the uncertainty in the rough sets theory.To handle this problem,an attribute reduction algorithm based on the particle swarm optimization takes the mutual information(MIPSO algorithm)as a term in the fitness function,The proposed MIPSO algorithm improves the regional shock search embedded particle swarm optimization algorithm(RSPSO)by enhancing the speed which the particle is close to the attractor,preventing from being local optimum early and finding the optimum as soon as possible.Consequently,the global convergence of the MIPSO algorithm is guaranteed as soon as possible.The experimental results show that the proposed MIPSO algorithm not only improves the optimization ability,accelerates the speed and improves the accuracy,but also can keep the mutual information value of all attributes before reducing approximately equal to the value of remaining attributes after reducing.

Key words: mutual information, particle swarm optimization, minimum attribute reduction, rough set, local search schemes

中图分类号:

TP181

续欣莹, 张扩, 谢珺, 谢刚. 基于互信息下粒子群优化的属性约简算法[J]. 电子学报, 2017, 45(11): 2695-2704.

XU Xin-ying, ZHANG Kuo, XIE Jun, XIE Gang. An Attribute Reduction Algorithm Based on Mutual Information of Particle Swarm Optimization[J]. Acta Electronica Sinica, 2017, 45(11): 2695-2704.

参考文献

[1] Pawlak Z.Rough sets[J].International Journal of Computer and Information Science,1982,11(5):341-356.
[2] 叶东毅.Jelonek属性约简算法的一个改进[J].电子学报,2000,28(12):81-82. Ye Dong-yi.An improvement to Jelonek's attribute reduction algorithm[J].Acta Electronica Sinica,2000,28(12):81-82.(in Chinese)
[3] Xu Xinying,Liu Haifeng,Shen Xuefen,Xie Jun.The research of attribute reduction algorithm based on extension neighborhood relation[J].Journal of Computational Information Systems,2013,9(16):6613-6620.
[4] Jensen R,Shen Q.Fuzzyrough sets for descriptive dimensionality reduction[A].Proc of 11th Internat Conf on Fuzzy Systems[C].Hawaii,2002.29-34.
[5] Zhang Xu,Song Ping.An attribute reduction algorithm based on clustering and attribute-activity sorting[A].Computational and Information Sciences (ICCIS),2010 International Conference on[C].IEEE,2010.709-712.
[6] Yao Yiyu,Deng Xiaofei.Quantitative rough sets based on subsethood measures[J].Information Sciences,2014,267(20):306-322
[7] He Yihai,et al.A fuzzy TOPSIS and Rough Set based approach for mechanism analysis of product infant failure[J].Engineering Applications of Artificial Intelligence,2016,47:25-37.
[8] Knorr E,Ng R,Tucakov V.Distance-based outliers:Algorithms and applications[J].VLDB Journal:Very Large Databases,2000,8(3-4):237-253.
[9] Lang G,Li Q,Yang T.An incremental approach to attribute reduction of dynamic set-valued information systems[J].International Journal of Machine Learning and Cybernetics,2014,5(5):775-788.
[10] Kennedy J,Eberhart R C.Particle swarm optimization[A].Proc of IEEE International Conference on Neural Networks[C].IEEE,1995.1942-1948.
[11] Vasant P,Ganesan T,Elamvazuthi I.An improved PSO approach for solving non-convex optimization problems.Proc of 20119th International Conference on ICT and Knowledge Engineering[C].IEEE,2012.80-87.
[12] Lei Kaiyou,Qiu Yuhui.A study of constrained layout optimization using adaptive particle swarm optimizer[J].Journal of Computer Research and Development,2006,43(10):1724-1731.
[13] 李订芳,章文,李贵斌,牛艳庆.基于可行域的遗传属性约简算法[J].小型微型计算机系统,2006,27(2):312-315. Li Dingfang,Zhang Wen,Li Guibin,Niu Yanqing.Genetic reduction algorithm based on feasible region[J].Journal of Chinese Computer Systems,2006,27(2):312-315.(in Chinese)
[14] Hu Xiaohua,Cercone N.Learning in relational databases:a rough set approach[J].Computational Intelligence,1995,11(2):323-338.
[15] Kennedy J,Eberhart R C.A discrete binary version of the particle swarm algorithm[A].Proc of IEEE International Conference on Systems,Man and Cybernetics[C].Piscataway,USA,1997.4104-4109.
[16] 廖建坤,叶东毅.基于免疫粒子群优化的最小属性约简算法[J].计算机应用,2007,27(3):550-555. Liao Jiankun,Ye Dongyi.Minimal attribute reduction algorithm based on particle swarm optimization with immunity[J].Journal of Computer Applications,2007,27(3):550-555.(in Chinese)
[17] 叶东毅,廖建坤.基于二进制粒子群优化的一个最小属性约简算法[J].模式识别与人工智能,2007,20(3):295-300.(in Chinese) Ye Dongyi,Liao Jiankun.Minimal attribute reduction algorithm based on particle swarm optimization with immunity[J].Pattern Recognition and Artificial Intelligence,2007,20(3):295-300.
[18] 叶东毅,陈昭炯.最小属性约简问题的一个有效的组合人工蜂群算法[J].电子学报,2015,43(5):1014-1020. Ye Dongyi,Chen Zhaojiong.An effcient combinatorial artificial bee colony alogorithm for solving minimum attribute reduction problem[J].Acta Electronica Sinica,2015,43(5):1014-1020.(in Chinese)
[19] 杨明.决策表中基于条件信息熵的近似约简[J].电子学报,2007,35(11):2156-2160. Yang Ming.Approximate reduction based on information reduction in decision tables[J].Acta Electronica Sinica,2007,35(11):2156-2160.(in Chinese)
[20] 汤继涛,戴月明.内嵌区域震荡搜索的粒子群优化算法[J].计算机工程与应用,2013,49(21):33-36. Tang Jitao,Dai Yueming.The oscillation search of PSO in embedded area[J].Computer Engineering and Applications,2013,49(21):33-36.(in Chinese)

基于互信息下粒子群优化的属性约简算法

An Attribute Reduction Algorithm Based on Mutual Information of Particle Swarm Optimization

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	周涛, 陆惠玲, 任海玲, 霍兵强. 基于粗糙集的属性约简算法综述[J]. 电子学报, 2021, 49(7): 1439-1449.
[2]	韩红桂, 阿音嘎, 张璐, 乔俊飞. 自适应分解式多目标粒子群优化算法[J]. 电子学报, 2020, 48(7): 1245-1254.
[3]	盛魁, 王伟, 卞显福, 董辉, 马健. 混合数据的邻域区分度增量式属性约简算法[J]. 电子学报, 2020, 48(4): 682-696.
[4]	尤殿龙, 郭松, 赵春慧, 原福永, 申利民, 陈真. 面向分类的流特征在线特征选择算法[J]. 电子学报, 2020, 48(2): 321-332.
[5]	王海东, 刘云敬, 康琳, 武迎春. 射频能量捕获传感网移动能量源的布置策略研究[J]. 电子学报, 2020, 48(12): 2367-2375.
[6]	李泽, 田增山, 王中春, 王亚. 基于粒子群优化的多径辅助室内定位算法[J]. 电子学报, 2020, 48(10): 1952-1960.
[7]	孙辉, 邓志诚, 赵嘉, 王晖, 谢海华. 混合均值中心反向学习粒子群优化算法[J]. 电子学报, 2019, 47(9): 1809-1818.
[8]	彭丝雨, 周到, 张家琦, 王宇, 高军峰. 基于互信息的脑网络及测谎研究[J]. 电子学报, 2019, 47(7): 1551-1556.
[9]	邓大勇, 葛雅雯, 黄厚宽. 属性约简簇的优化选择[J]. 电子学报, 2019, 47(5): 1111-1120.
[10]	黄锦旺, 吕善翔, 李广明, 袁华强. 基于增殖系数的混沌信号提取算法[J]. 电子学报, 2019, 47(4): 855-861.
[11]	李庆武, 马云鹏, 周亚琴, 邢俊. 基于无监督栈式降噪自编码网络的显著性检测算法[J]. 电子学报, 2019, 47(4): 871-879.
[12]	张行, 常颖, 宋康, 李春国, 杨绿溪. 一种新颖的水声信道参数估计算法[J]. 电子学报, 2019, 47(2): 509-512.
[13]	龙文, 蔡绍洪, 焦建军, 伍铁斌. 一种改进的灰狼优化算法[J]. 电子学报, 2019, 47(1): 169-175.
[14]	韩红桂, 武淑君. 基于收敛速度和多样性的多目标粒子群种群规模优化设计[J]. 电子学报, 2018, 46(9): 2263-2269.
[15]	刘兆广, 纪秀花, 刘云霞. 一种快速收敛的非参数粒子群优化算法及其收敛性分析[J]. 电子学报, 2018, 46(7): 1669-1674.