小数据集BN建模方法及其在威胁评估中的应用

doi:10.3969/j.issn.0372-2112.2016.06.035

电子学报 ›› 2016, Vol. 44 ›› Issue (6): 1504-1511.DOI: 10.3969/j.issn.0372-2112.2016.06.035

小数据集BN建模方法及其在威胁评估中的应用

邸若海, 高晓光, 郭志高

西北工业大学电子信息学院, 陕西西安 710129

收稿日期:2014-10-21 修回日期:2015-05-10 出版日期:2016-06-25
- 通讯作者:
- 高晓光
- 作者简介:
- 邸若海 男,1986年出生于陕西西安.现为西北工业大学博士研究生.主要研究方向为复杂系统建模和贝叶斯网络学习.E-mail:xfwtdrh@163.com
- 基金资助:
- 国家自然科学基金 (No.60774064,No.61305133); 全国高校博士点基金 (No.20116102110026); 中央高校基本科研业务费专项基金 (No.3102015KY0902,No.3102015BJ (Ⅱ)GH01)

The Modeling Method with Bayesian Networks and Its Application in the Threat Assessment Under Small Data Sets

DI Ruo-hai, GAO Xiao-guang, GUO Zhi-gao

School of Electronic and Information, Northwestern Polytechnical University, Xi'an, Shaanxi 710129, China

Received:2014-10-21 Revised:2015-05-10 Online:2016-06-25 Published:2016-06-25
- Supported by:
- National Natural Science Foundation of China (No.60774064, No.61305133); Research Fund for the Doctoral Program of Higher Education of China (No.20116102110026); Fundamental Research Funds for the Central Universities (No.3102015KY0902, No.3102015BJ (Ⅱ)GH01)

摘要/Abstract

摘要：

贝叶斯网络是数据挖掘领域的主要工具之一.在某些特定场合,如重大装备的故障诊断、地质灾害预测及作战决策等,希望用少量数据得到较好的结果.因此,本文针对小数据集条件下的贝叶斯网络学习问题展开研究.首先,建立基于连接概率分布的结构约束模型,提出I-BD-BPSO(Improved-Bayesian Dirichlet-Binary Particle Swarm Optimization)结构学习算法;其次,建立单调性参数约束模型,提出MCE(Monotonicity Constraint Estimation)参数学习算法;最后,应用所提算法构建威胁评估模型并应用变量消元法进行推理计算.实验结果表明,在小数据集条件下,本文的结构学习算法优于经典的二值粒子群优化算法,参数学习算法优于最大似然估计、保序回归及凸优化算法,并能够构建有效的威胁评估模型.

关键词: 贝叶斯网络, 小数据集, 二值粒子群优化, 威胁评估

Abstract:

Bayesian network is one of the main tools for data mining.In such cases as large equipment fault diagnosis, geological disaster forecast, operational decision, etc, good results are expected to achieve based on small data sets.Therefore, this article focuses on the problem of learning Bayesian network from small data sets.Firstly, the structure constraint model based on the probability distribution of the connection was built.Then, the improved-Bayesian Dirichlet-binary particle swarm optimization algorithm was proposed.Secondly, the monotonicity parameter constraint model was defined and the monotonicity constraint estimation algorithm was proposed.Finally, the proposed algorithm was applied to construct the threat assessment model.Then, the model was used for reasoning with the variable elimination method.Experimental results reveal that the structure learning algorithm outperforms classical binary particle swarm optimization algorithm and the parameter learning method surpasses maximum likelihood estimation, isotonic regression and convex optimization method for small data sets.The threat assessment model is also proved to be effective.

Key words: Bayesian network, small data sets, binary particle swarm optimization, threat assessment

中图分类号:

TP18

邸若海, 高晓光, 郭志高. 小数据集BN建模方法及其在威胁评估中的应用[J]. 电子学报, 2016, 44(6): 1504-1511.

DI Ruo-hai, GAO Xiao-guang, GUO Zhi-gao . The Modeling Method with Bayesian Networks and Its Application in the Threat Assessment Under Small Data Sets[J]. Acta Electronica Sinica, 2016, 44(6): 1504-1511.

参考文献

[1] SILANDER T,KONTKANEN P,MYLLYMAKI P.On sensitivity of the map Bayesian network structure to the equivalent sample size parameter[A].David H.Proceedings of the 23rd International Conference on Uncertainly in Artifical Intelligence[C].Vancouer:Springer,2008.360-367.
[2] 朱明敏,刘三阳,汪春峰.基于先验节点序学习贝叶斯网络结构的优化方法[J].自动化学报,2011,37(12):1514-1519. ZHU Ming-min,LIU San-yang,WANG Chun-feng.An optimization approach for structural learning Bayesian networks based on prior node ordering[J].Acta Automatica Sinica,2011,37(12):1154-1519.(in Chinese)
[3] COOPER G F,HERSKOVITS E.A Bayesian method for the induction of probabilistic networks from data[J].Machine Learning,1992,9(4):309-347.
[4] BORBOUDAKIS G,TSAMARDINOS I.Incorporating causal prior knowledge as path-constraints in Bayesian networks and maximal ancestral graphs[A].Andrew M.Proceedings of the 29th International Conference on Maching Learning[C].Edinburgh:ACM,2012.28-36.
[5] COMPOSC P,ZENG Z,JI Q.Structure learning of Bayesian networks using constraints[A].Dan R.Proceedings of the 26th International Conference on Maching Learning[C].Montreal:ACM,2009.280-287.
[6] CAMPOSC P,JI Q.Efficient structure learning of Bayesian networks using constraints[J].Journal of Machine Learning Research,2011,12(3):663-689.
[7] 吴红,王维平,杨峰.融合先验信息的贝叶斯网络结构学习方法[J].系统工程与电子技术,2012,34(12):2585-2591. WU Hong,WANG Wei-ping,YANG Feng.Structure learning method of Bayesian network with prior information[J].Systems Engineering and Electronics,2012,34(12):2585-2591.(in Chinese)
[8] ALTENDORF E,RESTICAR A.Learning from sparse data by exploiting monotonicity constraints[A].Max C.Proceedings of the 21st International Conference on Uncertainly in Artifical Intelligence[C].Edinburgh:Springer,2005.18-26.
[9] CAMPOS C P,JI Q.Improving Bayesian network parameter learning using constraints[A].Ejiri M.Proceedings of the 19th International Conference on Pattern Recognition[C].Florida:IEEE,2008.1-4.
[10] NICULESCU R S,MITCHELL T M.Bayesian network learning with parameter constraints[J].Journal of Machine Learning Research,2006,7(1):1357-1383.
[11] LIAO W H,QIANG J.Learning Bayesian network parameters under incomplete data with domain knowledge[J].Pattern Recognition,2009,42(11):3046-3056.
[12] FEELDER A D,VANDERGAGA L.Learning Bayesian networks parameters under order constraints[J].Journal of Approximate Reasoning,2006,42(1):37-53.
[13] 任佳,高晓光,茹伟.数据缺失的小样本条件下BN参数学习[J].系统工程理论与实践,2011,31(1):172-177. REN Jia,GAO Xiao-guang,RU Wei.Parameters learning of BN in small sample on data missing[J].Systems Engineering-Theory & Practice,2011,31(1):172-177.(in Chinese)
[14] RUI C,SHOEMAKER R,WANG W.Anovel knowledge-driven systems biology approach for phenotype prediction upon genetic intervention[J].IEEE Transactions on Computational Biology and Bioinformatics,2011,1(8):1170-1181.
[15] YUN Z,FENTON N,NEIL M.Bayesian network approach to multinomial parameter learning using data and expert judgments[J].Journal of Approximate Reasoning,2014,55(2):1252-1268.
[16] 高晓光,邸若海,郭志高.基于改进粒子群优化算法的贝叶斯网络结构学习[J].西北工业大学学报,2014,32(5):749-754. GAO Xiao-guang,DI Ruo-hai,GUO Zhi-gao.Structure learning of BN based on improved particle swarm optimaziton[J].Journal of Northwest Polytechnical University,2014,32(5):749-754.(in Chinese)nference on Pattern Recognition (ICPR 2008), pp. 1-4, Dec. 2008.
[38] 任佳,高晓光,茹伟. 数据缺失的小样本条件下BN参数学习[J].系统工程理论与实践,2011,31（1）：172-177. Ren jia Gao Xiao-guang Ru wei. Parameters learning of BN in small sample base on data missing[J].System Engineering-Theory & Practice,2011,31(1):172-177.
[39] R. S. Niculescu, T. M. Mitchell, R. B. Rao. Bayesian Network Learning with Parameter Constraints[J]. Journal of Machine Learning Research, vol. 7, no. 1, pp. 1357-1383, Jan. 2006.
[40] Rui Chang. Advanced Algorithm of Bayesian Network Learning and Inference from Prior Knowledge and Sparse Data with Applications in Computational Biology and Computer Vision. Bayesian Network, 2010
[41] Andrés Cano, Manuel Gómez-Olmedo. Locally averaged Bayesian Dirichlet metrics for learning the structure and the parameters of Bayesian networks[J]. Journal of Approximate Reasoning, vol. 54, no. 2, pp. 526-540, Feb. 2013
[42] Kobra Etminani, Mahmoud Naghibzadeh, Jose M. A democratic way of aggregating Bayesian network parameters[J]. Journal of Approximate Reasoning, vol. 54, no. 1, pp.602-614, Feb. 2013
[43] T. Isozaki, N. Kato, M. Ueno. Minimum Free Energies with “Data Temperature” for Parameter Learning of Bayesian Networks. International Journal of Artificial Intelligence Tools, vol. 18, no. 5, pp. 653-671, Oct. 2009.
[44] A Onisko, M. J. Druzdzel, Hanna Wasyluk. Learning Bayesian Network Parameters from Small Data Sets: Application of Noisy-OR Gates. Journal of Approximate Reasoning, vol. 27, no. 2, pp. 165-182, Feb. 2001.
[45] J. Kennedy and R. C. Eberhart. Particle swarm opimization [C],IEEE International Conference on Neural Network,1995,pp:1942-1948
[46] J. Kennedy and R. C. Eberhart, “A discrete binary version of the particle swarm algorithm,” in Proc. IEEE Int. Conf. System. Man Cybericle., 1997,pp:4104–4109.

小数据集BN建模方法及其在威胁评估中的应用

The Modeling Method with Bayesian Networks and Its Application in the Threat Assessment Under Small Data Sets

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	吕阳, 钱斌, 胡蓉, 张梓琪. 增强人工蜂群算法求解半导体最终测试调度问题[J]. 电子学报, 2021, 49(9): 1708-1715.
[2]	李海, 尚金雷, 孙婷逸, 冯青, 庄子波. 一种基于离散属性BNT的双偏振气象雷达降水粒子分类方法[J]. 电子学报, 2021, 49(3): 619-624.
[3]	高杨, 黄仰超, 程国兵, 段磊. 直觉模糊信息下基于VIKOR和三支决策的多目标威胁评估方法[J]. 电子学报, 2021, 49(3): 542-549.
[4]	谭翔元, 高晓光, 贺楚超. 基于马尔科夫毯约束的最优贝叶斯网络结构学习算法[J]. 电子学报, 2019, 47(9): 1898-1904.
[5]	韩博文, 姚佩阳, 钟赟, 丁云松, 刘子震. 基于QABC-IFMADM算法的有人/无人机编队作战威胁评估[J]. 电子学报, 2018, 46(7): 1584-1592.
[6]	房丙午, 黄志球, 王勇, 李勇. 基于混合贝叶斯网络的混合系统安全性分析方法[J]. 电子学报, 2017, 45(12): 2896-2902.
[7]	邱玉, 赵杰煜, 汪燕芳. 结合运动时序性的人脸表情识别方法[J]. 电子学报, 2016, 44(6): 1307-1313.
[8]	房丙午, 黄志球, 李勇, 王勇. 基于贝叶斯网络的复杂系统动态故障树定量分析方法[J]. 电子学报, 2016, 44(5): 1234-1239.
[9]	刘钰, 韩峰, 陆希成, 王建国. 电子系统电磁脉冲易损性评估的分层贝叶斯网络模型[J]. 电子学报, 2016, 44(11): 2695-2703.
[10]	王毅, 刘三阳, 张文, 王亚男. 属性权重不确定的直觉模糊多属性决策的威胁评估方法[J]. 电子学报, 2014, 42(12): 2509-2514.
[11]	朱明敏, 刘三阳, 杨有龙. 基于混合方式的贝叶斯网络等价类学习算法[J]. 电子学报, 2013, 41(1): 98-104.
[12]	王改革;郭立红;段红;刘逻;王鹤淇. 基于Elman_-AdaBoost强预测器的目标威胁评估模型及算法[J]. 电子学报, 2012, 40(5): 901-906.
[13]	王洪泊;涂序彦. 一种面向最经济服务流的可视化动态贝叶斯网络模型[J]. 电子学报, 2011, 39(6): 1331-1335.
[14]	王桢珍;姜欣;武小悦;谭旭. 信息安全风险概率计算的贝叶斯网络模型[J]. 电子学报, 2010, 38(2A): 18-22.
[15]	陈雁翔;刘鸣. 基于发音特征的音视频说话人识别鲁棒性的研究[J]. 电子学报, 2010, 38(12): 2920-2924.