National Natural Science Foundation of China (No.61075092, No.61203341, No.61173079);Science and Technology Development Project of Higher Education Institutions in Shandong Province (No.TJY1112);Open Project of Key Laboratory of Solar Activity of Chinese Academy of Sciences (No.TQT1302)
YIN Jian-qin, TIAN Guo-hui, WEI Jun, et al. Research on the Relationship of the Support and the Discriminative Ability for Classification of Features[J]. Acta Electronica Sinica, 2015, 43(2): 248-254.
DOI:
YIN Jian-qin, TIAN Guo-hui, WEI Jun, et al. Research on the Relationship of the Support and the Discriminative Ability for Classification of Features[J]. Acta Electronica Sinica, 2015, 43(2): 248-254. DOI: 10.3969/j.issn.0372-2112.2015.02.007.
Research on the Relationship of the Support and the Discriminative Ability for Classification of Features
Frequent pattern mining is used widely in feature selection for classification problem.In order to provide theoretical basis for the application
we established the relationship between the classification discriminative ability and the support of the feature.Information gain was adopted as evaluation criteria
and we discussed the connection between the support of the feature and its discriminative ability.Firstly
we proved the information gain is a concave function about the support of the feature;secondly
we proved the conclusion that the feature with too-high or too-low support has limited discriminative ability under the two classes and multiple classes circumstances separately;Finally
simulation experiments validate our conclusions.And the conclusion provides a theoretical basis for the application of frequent pattern mining in classification problems.