基于神经网络的纠错输出编码方法研究

doi:10.3969/j.issn.0372-2112.2013.06.012

电子学报 ›› 2013, Vol. 41 ›› Issue (6): 1114-1121.DOI: 10.3969/j.issn.0372-2112.2013.06.012

基于神经网络的纠错输出编码方法研究

周进登¹, 周红建¹, 杨云¹, 郭长华², 胡洪宇³

1. 空军装备软件测评中心, 北京 100076;
2. 广空装备部军通处, 广东广州 510071;
3. 驻成飞公司军事代表室, 四川成都 610091

收稿日期:2011-09-25 修回日期:2012-10-11 出版日期:2013-06-25
- 通讯作者:
- 周进登男,1984年生于江西鹰潭.博士.研究方向为模式识别和智能信息处理. E-mail: zhoujin198417@yahoo.com.cn
- 作者简介:
- 杨云男,1969年生于甘肃,高级工程师,研究方向为软件工程装备论证.周红建男,1972生于湖北荆州,博士,研究方向为软件工程和系统仿真.

Coding Design for Error Correcting Output Codes Based on Neural Network

ZHOU Jin-deng¹, ZHOU Hong-jian¹, YANG Yun¹, GUO Chang-hua², HU Hong-yu³

1. Air Force Equipment Software Testing Center, Beijing 100076, China;
2. Equipment Department of Air Force of Guangzhou Military Region, Guangzhou, Guangdong 510071, China;
3. Military Representatives Office of PLA, Chengdu, Sichuan 610091, China

Received:2011-09-25 Revised:2012-10-11 Online:2013-06-25 Published:2013-06-25

摘要/Abstract

摘要： 构造基于数据编码矩阵是目前利用纠错输出编码解决多类分类问题的研究重点.为此提出利用单层感知器作为学习框架,结合解码策略把输出编码矩阵各码元值映射为感知器网络中的权值,同时引入含权值取值约束的目标函数作为该网络代价函数,并对其进行学习,最终得到基于子类划分的数据编码矩阵.实验中利用人工数据集和UCI数据集并选择线性逻辑分类器作为基分类器分别进行测试,通过与几种经典编码方法比较,结果表明该编码方法能在编码长度较小情况下得到更好的分类效果.

关键词: 多类分类, 纠错输出编码, 神经网络

Abstract: It is known that error-correcting output codes (ECOC) is a common way to model multiclass classification problems,in which the research of encoding based on data especially attracts attentions.In this paper,we proposed a method for learning error-correcting output codes with the help of a single layered perception neural network.To achieve this goal,the code elements of ECOC are mapped to the weights of network for the given decoding strategy,and an object function with the constrained weights used as a cost function of network.After the training,we can obtain a coding matrix including lots of subgroups of class.Experimental results on artificial data and UCI with logistic linear classifier (LOGLC) as the binary learner show that our scheme provides better performance of classification with shorter length of coding matrix than other state-of-the-art encoding strategies.

Key words: multiclass categorization, error-correcting output codes, neural network

中图分类号:

TN912-34

周进登, 周红建, 杨云, 等. 基于神经网络的纠错输出编码方法研究[J]. 电子学报, 2013, 41(6): 1114-1121.

ZHOU Jin-deng, ZHOU Hong-jian, YANG Yun, et al. Coding Design for Error Correcting Output Codes Based on Neural Network[J]. Acta Electronica Sinica, 2013, 41(6): 1114-1121.

参考文献

[1] E Alpaydin,E Mayoraz.Learning error-correcting output codes from data[A].Proceedings of International Conference on Artificial Neural Networks (ICANN'99)[C] Verlag:Springer,1999.743-748.

[2] W Utschick,W Weichselberger.Stochastic organization of output codes in multiclass learning problems[J].Neural Comput,2001,13(5):1065-1102.

[3] K Crammer,Y Singer.On the learnability and design of output codes for multiclass problems[J].Machine Learning,2002,47(2):201-233.

[4] O Pujol,P Radeva,J Vitria.Discriminate ECOC:A heuristic method for application dependent design of error correcting output codes[J].IEEE Trans Pattern Analysis and Machine Intelligence,2006,28(6):1001-1007.

[5] S Escalera,David M J Tax,O Pujol,P Radeva,Robert P W Duin.Subclass problem-dependent design for error-correcting output codes[J].IEEE Trans Pattern Analysis and Machine Intelligence,2008,30(6):1041-1054.

[6] Jiang Yan-huang,Zhao Qiang-li,Yang Xue-jun.A search coding method and its application in supervised classification[J].Journal of Software,2005,16(6):1081-1088.

[7] Jin Deng Zhou,Xiao Dan Wang,Heng Song.Research on the unbiased probability estimation of error-correcting output coding[J].Pattern Recognition,2011,44(7):1552-1565.

[8] S Nowlan,G Hinton.Simplifying neural networks by soft weight sharing[J].Neural Comp,1992,23(4):473-493.

[9] J Demsar.Statistical comparisons of classifiers over multiple data sets[J].Journal of Machine Learning Research,2006,7(1):1-30.

[10] 尹安容,谢湘,匡镜明.Hadamard纠错码结合支持向量机在多分类问题中的应用[J].电子学报2008,36(1):122-126. Yin An-rong,Xie Xiang,Kuang Jing-ming.Application of hadamard ECOC in multi-class problems based on SVM[J].Acta Electronic Sinica,2008,36(1):122-126.(in Chinese)

[11] 周进登,王晓丹,权文.加权解码在解决纠错输出编码Consistent-Diverse平衡问题的应用[J].电子学报,2011,20(7):1514-1522. Zhou Jin-deng,Wang Xiao-dan,Quan Wen.Application of weighted decoding for the consistent-diverse balance problem of error correcting output codes[J].Acta Electronic Sinica,2011,20(7):1514-1522.(in Chinese)

[1]	黄赟, 张帆, 郭威, 陈立, 羊光. 一种基于数据标准差的卷积神经网络量化方法[J]. 电子学报, 2023, 51(3): 639-647.
[2]	张金颢, 周恒, 张守龙, 蒋廷勇, 王胜涛, 刘真. 基于仿真及神经网络的大型电磁脉冲模拟器近区场计算[J]. 电子学报, 2023, 51(3): 712-719.
[3]	吕杭, 蒋明峰, 李杨, 张鞠成, 王志康. 基于混合时频域特征的卷积神经网络心律失常分类方法的研究[J]. 电子学报, 2023, 51(3): 701-711.
[4]	王子为, 鲁继文, 周杰. 基于自适应梯度优化的二值神经网络[J]. 电子学报, 2023, 51(2): 257-266.
[5]	杨利平, 侯振威, 辜小花, 郝峻永. 弱标签声音事件检测的空间-通道特征表征与自注意池化[J]. 电子学报, 2023, 51(2): 297-306.
[6]	许新征, 李杉. 基于特征膨胀卷积模块的轻量化技术研究[J]. 电子学报, 2023, 51(2): 355-364.
[7]	丁琪, 田萱, 孙国栋. 基于注意力增强的热点感知新闻推荐模型[J]. 电子学报, 2023, 51(1): 93-104.
[8]	张永梅, 孙捷. 基于动静态特征双输入神经网络的咳嗽声诊断COVID-19算法[J]. 电子学报, 2023, 51(1): 202-212.
[9]	王神龙, 雍宇, 吴晨睿. 基于伪孪生神经网络的低纹理工业零件6D位姿估计[J]. 电子学报, 2023, 51(1): 192-201.
[10]	袁海英, 成君鹏, 曾智勇, 武延瑞. Mobile_BLNet：基于Big-Little Net的轻量级卷积神经网络优化设计[J]. 电子学报, 2023, 51(1): 180-191.
[11]	王硕, 王坚, 王亚男, 宋亚飞. 一种基于特征融合的恶意代码快速检测方法[J]. 电子学报, 2023, 51(1): 57-66.
[12]	吴靖, 叶晓晶, 黄峰, 陈丽琼, 王志锋, 刘文犀. 基于深度学习的单帧图像超分辨率重建综述[J]. 电子学报, 2022, 50(9): 2265-2294.
[13]	毛国君, 王者浩, 黄山, 王翔. 基于剪边策略的图残差卷积深层网络模型[J]. 电子学报, 2022, 50(9): 2205-2214.
[14]	袁海英, 曾智勇, 成君鹏. 面向灵活并行度的稀疏卷积神经网络加速器[J]. 电子学报, 2022, 50(8): 1811-1818.
[15]	徐兴荣, 刘聪, 李婷, 郭娜, 任崇广, 曾庆田. 基于双向准循环神经网络和注意力机制的业务流程剩余时间预测方法[J]. 电子学报, 2022, 50(8): 1975-1984.

基于神经网络的纠错输出编码方法研究

Coding Design for Error Correcting Output Codes Based on Neural Network

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics