1. 吉林大学计算机科学与技术学院,吉林,长春,130012
2. 长春理工大学计算机科学技术学院,吉林,长春,130022
3. 吉林大学计算机科学与技术学院,吉林,长春,130012
4. 长春理工大学计算机科学技术学院,吉林,长春,130022
网络出版:2018-01-25,
纸质出版:2018
移动端阅览
胡小娟, 刘磊, 邱宁佳. 基于主动学习和否定选择的垃圾邮件分类算法[J]. 电子学报, 2018,46(1):203-209.
HU Xiao-juan, LIU Lei, QIU Ning-jia. A Novel Spam Categorization Algorithm Based on Active Learning Method and Negative Selection Algorithm[J]. Acta Electronica Sinica, 2018, 46(1): 203-209.
胡小娟, 刘磊, 邱宁佳. 基于主动学习和否定选择的垃圾邮件分类算法[J]. 电子学报, 2018,46(1):203-209. DOI: 10.3969/j.issn.0372-2112.2018.01.028.
HU Xiao-juan, LIU Lei, QIU Ning-jia. A Novel Spam Categorization Algorithm Based on Active Learning Method and Negative Selection Algorithm[J]. Acta Electronica Sinica, 2018, 46(1): 203-209. DOI: 10.3969/j.issn.0372-2112.2018.01.028.
针对现在网络上泛滥的垃圾邮件问题,本文结合主动学习方法和否定选择算法提出了一种二类文本分类方法:主动否定学习算法.根据用户少量标注建立双向兴趣集,利用否定选择算法的自体异常检测机制改善主动学习中的采样策略,并将双向兴趣集作为检测器,新增样本集作为自体集,对两者进行异常匹配.本文算法与在线垃圾邮件快速识别方法、增强差异性的半监督协同分类算法、垃圾邮件过滤方法、基于人工高免疫的多层垃圾邮件过滤算法和在线主动多领域学习方法在六个常用邮件语料集上进行了分析比较,结果表明本文算法具有较高的准确率、召回率、分类精度,和较低的用户标注负担.使用用户个性喜好转换为双向兴趣特征的方式有助于提高算法的分类能力;利用异常检测匹配选取未知类别特征的方式,有效地降低了用户标注负担.
A two-class text categorization method
active learning negative selection text categorization (ALNSTC) algorithm
based on active learning (AL) method and negative selection (NS) algorithm
is proposed for the problem of spam proliferation. The positive user interest set and the negative user interest set are established according to a small number of labeled samples. And the sampling engine (SE) of AL method is improved by the autologous anomaly detection mechanism of the NS algorithm. The two-way user interest sets are used as detectors
and a new sample set is employed as a self-set. The above two sets are matched with Hamming match rules. The classification process of each sample set is able to update the two user interest sets. The proposed algorithm is carried out with a full-scale test on six common spam corpus
which are selected as experimental material
and analyzed and compared with other five state-of-the-art spam classification methods
which are quick online spam identification (QOSI) method
semi-supervised collaboration classification algorithm with enhanced difference (DSCC)
dynamic web spam filtering (WSF2) method
multilevel spam filtering algorithm based on artificial immunity (MSFA-AI)
and integrated multi-field learning (MFL) method
in different evaluation metrics
such as precision
recall
ROC curve
categorization running time and the labeled number of spam. The results show that the proposed method has better precision rate
recall rate
classification accuracy
and can reduce the artificial labeled number of spam samples. It is advantageous to enhance the classification capacity of the algorithm that the user preferences are converted into positive and negative user interest sets. In addition
the user labeled number is reduced when unknown category features are obtained by the exception detection mechanism.
0
浏览量
4
下载量
11
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621