一种基于神经网络的广义熵模糊聚类算法

doi:10.3969/j.issn.0372-2112.2016.08.016

电子学报 ›› 2016, Vol. 44 ›› Issue (8): 1881-1886.DOI: 10.3969/j.issn.0372-2112.2016.08.016

一种基于神经网络的广义熵模糊聚类算法

李凯, 曹喆

河北大学计算机科学与技术学院, 河北保定 071000

收稿日期:2015-12-08 修回日期:2016-03-18 出版日期:2016-08-25
- 作者简介:
- 李凯男,1963年出生,河北保定人.2005年毕业于北京交通大学计算机与信息技术学院,并获得工学博士学位.主要从事机器学习、模式识别、数据挖掘等方面的研究.E-mail:likai@hbu.edu.cn;曹喆女,1991年出生,河北邢台人,硕士研究生.主要从事机器学习和数据挖掘等方面的研究.
- 基金资助:
- 国家自然科学基金 (No.61375075）

A Fuzzy Clustering Algorithm with Generalized Entropy Based on Neural Network

LI Kai, CAO Zhe

School of Computer Science and Technology, Hebei University, Baoding, Hebei 071000, China

Received:2015-12-08 Revised:2016-03-18 Online:2016-08-25 Published:2016-08-25

摘要/Abstract

摘要： 以模糊聚类为基础，将广义熵引入到模糊聚类的目标函数中，提出一种基于模糊熵的模糊聚类的统一形式，即广义熵模糊聚类模型；利用增广拉格朗日求解方法，以及Hopfield神经网络和复突触神经网络解决了基于广义熵的目标函数的优化问题，提出了基于神经网络的广义熵模糊聚类算法，表明了使用神经网络求解的收敛性；同时，给出一种用于确定增广拉格朗日乘子的迭代方法.实验中选取人工生成数据集和UCI标准数据集对提出的算法进行了实验研究，并与常用的聚类算法进行了性能比较.

关键词: 模糊聚类, 广义熵, 增广拉格朗日方法, 神经网络

Abstract: Based on fuzzy clustering,an unified form is presented for fuzzy clustering algorithm based on fuzzy entropy by introducing the generalized fuzzy entropy into objective function of fuzzy clustering,namely generalized entropy's fuzzy clustering model.Optimization problem for generalized entropy's objective function is solved using Hopfield neural network and multiple synapses based on augmented Lagrange method.After that,the generalized entropy's fuzzy clustering algorithm based on neural network is presented.And convergence of neural network is shown.At the same time,iterative method is given to determine Lagrange multipliers.In experiments,a synthetic data set and some standard UCI data sets are chosen to conduct some experimental studies.And clustering performance is compared with commonly used clustering algorithms.

Key words: fuzzy clustering, generalized entropy, augmented Lagrange method, neural network

中图分类号:

TP18

李凯, 曹喆. 一种基于神经网络的广义熵模糊聚类算法[J]. 电子学报, 2016, 44(8): 1881-1886.

LI Kai, CAO Zhe. A Fuzzy Clustering Algorithm with Generalized Entropy Based on Neural Network[J]. Acta Electronica Sinica, 2016, 44(8): 1881-1886.

参考文献

[1] Timothy C H,James C B,Christopher L,et al.Fuzzy c-Means algorithms for very large data[J].IEEE Transactions on Fuzzy Systems,2012,20(6):1130-1146.
[2] 慕彩红,霍利利,刘逸,刘若辰,焦李成.基于小波融合和PCA-核模糊聚类的遥感图像变化检测[J].电子学报,2015,43(7):1375-1381.Mu Caihong,Huo Lili,Liu Yi,Jiao Licheng.Change detection for remote sensing images based on wavelet fusion and PCA-kernel fuzzy clustering[J].Acta Electronica Sinica,2015,43(7):1375-1381.(in Chinese)
[3] Yang M S,Tsai H S.A gaussian kernel-based fuzzy c-means algorithm with a spatial bias correction[J].Pattern Recognition Letters,2008,29(12):1713-1725.
[4] 刘兵,夏士雄,周勇,韩旭东.基于样本加权的可能性模糊聚类算法[J].电子学报,2012,40(2):371-375.Liu Bing,Xia Shixiong,Zhou Yong,Han Xudong.A sample-weighted possibilistic fuzzy clustering algorithm[J].Acta Electronica Sinica,2012,40(2):371-375.(in Chinese)
[5] Jacek M L.Fuzzy c-ordered-means clustering[J].Fuzzy Sets and Systems,2016,286,114-133.
[6] Ding Y,Fu X.Kernel-based fuzzy c-means clustering algorithm based on genetic algorithm[J].Neurocomputing,doi:10.1016/j.neucom.2015.01.106.
[7] Krishnapuram R,Keller,J M.A possibilistic approach to clustering[J].IEEE Transactions on Fuzzy Systems,1993,1(2):98-110.
[8] Krishnapuram R,Keller J M.The possiblistic means algorithms:insights and recommendation[J].IEEE Transactions on Fuzzy Systems,1996,4(3):385-393.
[9] Karayiannis N B.MECA:maximum entropy clustering algorithm[A].IEEE world congress on computational intelligence,Proceedings of the third IEEE conference on fuzzy systems[C].Orlando:IEEE,1994.630-635.
[10] Ichihashi H,Miyagishi K,Honda K.Fuzzy c-means clustering with regularization by K-L information[A].Proceedings of the 10th IEEE international conference on fuzzy systems[C].Melbourne:IEEE,2001.924-927.
[11] Yasuda M,Furuhashi T,Matsuzaki M,et al.A study on statistical mechanical characteristics of fuzzy clustering[A].Proceedings of IEEE International Conference on Systems,Man,and Cybernetics[C].Tucson:IEEE,2001.2415-2420.
[12] Frigui H,Krishnapuram R.Clustering by competitive agglomeration[J].Pattern Recognition,1997,30(7):1109-1119.
[13] Grira N,Crucianu M,Boujemaa N.Active semi-supervised fuzzy clustering[J].Pattern Recognition,2008,41(5):1834-1844.
[14] Gao C F,Wu X J.A new semi-supervised clustering algorithm with pairwise constraints by competitive agglomeration[J].Applied Soft Computing,2011,11(8):5281-5291.
[15] Maraziotis I A.A semi-supervised fuzzy clustering algorithm applied to gene expression data[J].Pattern Recognition,2012,45:637-648.
[16] Pedrycz W,Amato A,Lecce V D,et al.Fuzzy clustering with partial supervision in organization and classification of digital images[J].IEEE Transactions on Fuzzy Systems,2008,16(4):1008-1026.
[17] Wei C,Fahn C.The multisynapse neural network and its application to fuzzy clustering[J].IEEE Transactions on Neural Networks,2002,13(3):600-618.
[18] Yu J,Hao P W.Comments on "The multisynapse neural network and its application to fuzzy clustering"[J].IEEE Transaction on Neural Networks,2005,16(3):777-778.
[19] Li K,Ma H Y,Wang Y.Unified model of fuzzy clustering algorithm based on entropy and its application to image segmentation[J].Journal of Computational Information Systems,2011,7(15):5476-5483.
[20] 刘健,王晓明著.鞍点规划与形位误差评定[M].大连:大连理工大学出版社,1996.Liu Jian,Wang Xiaoming.Saddle Point Programming and Geometric Error Evaluation[M].Dalian:Dalian University of Technology Press,1996.
[21] Liu H,Yih J M,Wu D B,Liu S W.Fuzzy c-mean clustering algorithms based on picard iteration and particle swarm optimization[A].Proceedings of International Workshop on Education Technology and Training[C].Washington:IEEE,2008.838-842.
[22] Zhang X B,Huang H,Zhang S.A FCM clustering algorithm based on semi-supervised and point density weighted[A].Proceedings of IEEE International Conference on Intelligent Computing and Intelligent Systems[C].Xiamen:IEEE,2010.710-713.

一种基于神经网络的广义熵模糊聚类算法

A Fuzzy Clustering Algorithm with Generalized Entropy Based on Neural Network

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	吴靖, 叶晓晶, 黄峰, 陈丽琼, 王志锋, 刘文犀. 基于深度学习的单帧图像超分辨率重建综述[J]. 电子学报, 2022, 50(9): 2265-2294.
[2]	毛国君, 王者浩, 黄山, 王翔. 基于剪边策略的图残差卷积深层网络模型[J]. 电子学报, 2022, 50(9): 2205-2214.
[3]	袁海英, 曾智勇, 成君鹏. 面向灵活并行度的稀疏卷积神经网络加速器[J]. 电子学报, 2022, 50(8): 1811-1818.
[4]	徐兴荣, 刘聪, 李婷, 郭娜, 任崇广, 曾庆田. 基于双向准循环神经网络和注意力机制的业务流程剩余时间预测方法[J]. 电子学报, 2022, 50(8): 1975-1984.
[5]	王相海, 赵晓阳, 王鑫莹, 赵克云, 宋传鸣. 非抽取小波边缘学习深度残差网络的单幅图像超分辨率重建[J]. 电子学报, 2022, 50(7): 1753-1765.
[6]	张志文, 刘天歌, 聂鹏举. 基于实景数据增强和双路径融合网络的实时街景语义分割算法[J]. 电子学报, 2022, 50(7): 1609-1620.
[7]	丁毅, 沈薇, 李海生, 钟琼慧, 田明宇, 李洁. 面向CNN的区块链可信隐私服务计算模型[J]. 电子学报, 2022, 50(6): 1399-1409.
[8]	张波, 陆云杰, 秦东明, 邹国建. 一种卷积自编码深度学习的空气污染多站点联合预测模型[J]. 电子学报, 2022, 50(6): 1410-1427.
[9]	吴晓晓, 李刚强, 张胜利. 分布式协作频谱感知网络中恶意节点检测和定位方法研究[J]. 电子学报, 2022, 50(6): 1370-1380.
[10]	廖勇, 李玉杰. 一种轻量化低复杂度的FDD大规模MIMO系统CSI反馈方法[J]. 电子学报, 2022, 50(5): 1211-1217.
[11]	张云, 化青龙, 姜义成, 徐丹. 基于混合型复数域卷积神经网络的三维转动舰船目标识别[J]. 电子学报, 2022, 50(5): 1042-1049.
[12]	冀振燕, 韩梦豪, 宋晓军, 冯其波. 面向激光光条图像修复的循环相似度映射网络[J]. 电子学报, 2022, 50(5): 1234-1242.
[13]	袁冠, 邴睿, 刘肖, 代伟, 张艳梅, 蔡卓. 基于时空图神经网络的手势识别[J]. 电子学报, 2022, 50(4): 921-931.
[14]	王延达, 陈炜通, 皮德常, 岳琳. 一种自适应记忆神经网络多跳读取与覆盖度机制结合的药物推荐模型[J]. 电子学报, 2022, 50(4): 943-953.
[15]	崔亚奇, 何友, 唐田田, 熊伟. 一种深度学习航迹关联方法[J]. 电子学报, 2022, 50(3): 759-763.