Markov微分博弈模型及其在网络安全中的应用

doi:10.3969/j.issn.0372-2112.2019.03.013

电子学报 ›› 2019, Vol. 47 ›› Issue (3): 606-612.DOI: 10.3969/j.issn.0372-2112.2019.03.013

Markov微分博弈模型及其在网络安全中的应用

张恒巍^1,2, 黄世锐¹

1. 信息工程大学三院, 河南郑州 450001;
2. 信息保障技术重点实验室, 北京 100093

收稿日期:2017-09-07 修回日期:2018-02-05 出版日期:2019-03-25
- 通讯作者:
- 黄世锐
- 作者简介:
- 张恒巍 男,1978年出生,河南洛阳人,博士,信息工程大学副教授,研究方向为网络安全与攻防对抗、信息安全风险评估.E-mail:zhw11qd@126.com
- 基金资助:
- 国家自然科学基金 (No.61303074，No.61309013）; 河南省科技攻关计划基金 (No.182102210144）; 信息保障技术重点实验室开放基金 (No.KJ-15-110）

Markov Differential Game Model and Its Application in Network Security

ZHANG Heng-wei^1,2, HUANG Shi-rui¹

1. The Third Institute, Information Engineering University, Zhengzhou, Henan 450001, China;
2. Science and Technology on Information Assurance Laboratory, Beijing 100093, China

Received:2017-09-07 Revised:2018-02-05 Online:2019-03-25 Published:2019-03-25

摘要/Abstract

摘要： 当前基于博弈理论的网络安全研究成果难以应用于实时、连续、随机对抗的网络攻防过程.本文针对网络安全防御的实时性和网络状态变化的随机性，基于动态、实时对抗的视角分析攻防行为，在结合微分博弈模型和Markov决策方法的基础上进行扩展，构建Markov攻防微分博弈模型，分析具有多个阶段且每阶段持续时间较短的攻防过程；提出多阶段博弈均衡解计算方法，设计多阶段最优防御策略选取算法.仿真实验结果表明，模型和算法有效且可行.

关键词: 网络安全, 网络攻防, 博弈论, 微分博弈, Markov决策, 网络防御, 攻防行为分析, 最优防御策略

Abstract: The current research of network security based on game theory fails to analyze the real-time,continuous,and random network attack and defense process.For the randomness of security states and the real-time character of network defense decision-making,we analyzed the network attack and defense behaviors from the view of dynamic and real-time confrontation.Then we combined and extended the differential game model and Markov decision-making method.On these basis,a Markov attack-defense differential game model is constructed,which can be adopted to analyze the multi-stage attack and defense process with short duration in each stage.Besides,a multi-stage game equilibrium solution is proposed,and an optimal defense strategy selection algorithm is designed.Finally,the experiments demonstrate that the model and method proposed in this paper are valid.

Key words: network security, network attack and defense, game theory, differential game, Markov decision-making, network defense, attack-defense analysis, optimal defense strategies

中图分类号:

TP309

张恒巍, 黄世锐. Markov微分博弈模型及其在网络安全中的应用[J]. 电子学报, 2019, 47(3): 606-612.

ZHANG Heng-wei, HUANG Shi-rui. Markov Differential Game Model and Its Application in Network Security[J]. Acta Electronica Sinica, 2019, 47(3): 606-612.

参考文献

[1] Moore D,Shannon C,Voelker G M.Budgeting process for information security expenditures[J].Communications of the ACM,2016,49(10):121-125.
[2] Drew Fudenberg,Jean Tirole.Game Theory[M].Boston:Massachusettes Institute of Technology Press,2015.
[3] White J,Park J S,Kamhoua C A,et al.Game theoretic attack analysis in online social network services[A].2016 International Conference on Social Networks Technology[C].Los Angeles:IEEE Press, 2016.312-319.
[4] Shordon L,Meliyt J.Network survivability analysis based on game model[J].Multimedia Information Networking and Security,2016,55(5):199-204.
[5] 张恒巍,李涛.基于多阶段攻防信号博弈的最优主动防御[J].电子学报,2017,45(2):431-439.ZHANG Heng-wei,LI Tao.Optimal active defense based on multi-stage attack-defense signaling game[J].Acta Electronica Sinica,2017,45(2):431-439.(in Chinese)
[6] David W K Yeung,Leon A Petrosyan.Differential Games Theory[M].New York:Springer Press,2014.
[7] Nilim A,Ghaoui L E.Active defense strategy selection based ondifferential game[J].Operations Research,2016,43(12):163-169.
[8] 张恒巍,黄世锐.基于攻防微分博弈的网络安全防御决策方法[J].电子学报,2017,45(6):887-894.ZHANG Heng-wei,HUANG Shi-rui.Network defense decision-making method based on attack-defense differential game[J].Acta Electronica Sinica,2017,45(6):887-894.(in Chinese)
[9] Erwin A,Alex P.Modeling analysis and control of network security based on Markov games[J].IEEE Transactions on Automatic Control,2017,57(5):41-49.
[10] SUN Wei,KONG Xiangwei,HE Dequan,et al.Research on attack and deference in information security based onstochastic game[J].ACM Information security Science and Technology,2015,27(9),1408-1412.
[11] 王元卓,林闯,程学旗,等.基于随机博弈模型的网络攻防量化分析方法[J].计算机学报,2014,33(9):1748-1764.WANG Yuan-zhuo,LIN Chuang,CHENG Xue-qi,et al.Analysis fornetwork attack-defense based on stochastic game model[J].Chinese Journal of Computers,2014,33(9):1748-1764.(in Chinese)
[12] 范红旗,王胜.二人微分对策问题信息模式的数学描述[J].电子学报,2015,42(2):355-361.FAN Hong-qi,WANG Sheng.Mathematical descriptionfor information pattern of stochastic differential games[J].Acta Electronica Sinica,2015,42(2):355-361.(in Chinese)
[13] Martin A Nowak.Evolutionary Dynamics:Exploring the Equations of Life[M].Boston:Harvard University Press,2013.
[14] Richard Lippmann,Joshua W Haines.Analysis and results of the network intrusion detection evaluation[A].The 19'th International Workshop on Recent Advances in Intrusion Detection[C].New York:ACM Press,2016.162-182.
[15] Nilim A,Ghaoui L E.Robust control of Markov decision processes with uncertain transition matrices[J].Operations Research,2016,53(5):780-798.
[16] Valizadeh M,Koch W.Scalable Simulation Framework on Network[DB/OL].http://www.ssfnet.org,2012-11-08/2017-06-16.
[17] Gordon L,Loeb M,Lucyshyn W,Richardson R.2015 CSI/FBI computer crime and security survey[A].2015 Computer Security Institute[C].San Francisco:IEEE Press,2015.169-179.

Markov微分博弈模型及其在网络安全中的应用

Markov Differential Game Model and Its Application in Network Security

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	张清华, 黄志康, 高满, 艾志华. 基于不确定性与错误分类率博弈的序贯三支决策模型[J]. 电子学报, 2022, 50(5): 1033-1041.
[2]	王刚, 陆世伟, 冯云, 刘文斌, 马润年. 网络节点增减下的潜伏型病毒传播行为建模研究[J]. 电子学报, 2022, 50(2): 273-283.
[3]	蒋侣, 张恒巍, 王晋东. 基于多阶段Markov信号博弈的移动目标防御最优决策方法[J]. 电子学报, 2021, 49(3): 527-535.
[4]	黄美根, 郁滨. 软件定义WSN规则一致更新研究[J]. 电子学报, 2019, 47(9): 1965-1971.
[5]	罗睿辞, 叶蔚, 刘学洋, 孙基男, 张世琨. 基于拥塞博弈的微服务运行时资源管理方法[J]. 电子学报, 2019, 47(7): 1497-1505.
[6]	李艳, 王纯子, 黄光球, 赵旭, 张斌, 李盈超. 网络安全态势感知分析框架与实现方法比较[J]. 电子学报, 2019, 47(4): 927-945.
[7]	李秋贤, 田有亮, 王缵. 基于全同态加密的理性委托计算协议[J]. 电子学报, 2019, 47(2): 470-474.
[8]	王鹏超, 陈福才, 程国振, 陈扬, 谷允捷. 软件定义的L2/L3地址协同拟态伪装策略研究[J]. 电子学报, 2019, 47(10): 2032-2039.
[9]	黄健明, 张恒巍. 基于随机演化博弈模型的网络防御策略选取方法[J]. 电子学报, 2018, 46(9): 2222-2228.
[10]	张恒巍, 李涛, 黄世锐. 基于攻防微分博弈的网络安全防御决策方法[J]. 电子学报, 2018, 46(6): 1428-1435.
[11]	张恒巍, 黄健明. 基于Markov演化博弈的网络防御策略选取方法[J]. 电子学报, 2018, 46(6): 1503-1509.
[12]	汪志勇, 张沪寅, 徐宁, 郝圣. 认知无线电网络中基于随机学习博弈的信道分配与功率控制[J]. 电子学报, 2018, 46(12): 2870-2877.
[13]	李立勋, 张斌, 董书琴, 唐慧林. 基于脆弱性变换的网络动态防御有效性分析方法[J]. 电子学报, 2018, 46(12): 3014-3020.
[14]	张恒巍, 李涛. 基于多阶段攻防信号博弈的最优主动防御[J]. 电子学报, 2017, 45(2): 431-439.
[15]	陈白, 辛敏洁, 刘伟静, 姚宁, 郝晓辰, 汝小月. 一种基于链路质量的自维护拓扑控制博弈算法[J]. 电子学报, 2016, 44(9): 2227-2234.