1.西安电子科技大学,陕西西安 710000
2.中兴通讯股份有限公司,陕西西安 710000
齐佩汉 男,1986年9月出生于河南省永城市。现任西安电子科技大学通信工程学院教授。主要研究方向为压缩感知、认知无线电网络频谱感知及智能信号处理。中国电子学会会员编号:E190027763M。E-mail: phqi@xidian.edu.cn
刘智豪 男,2002年1月出生于河南省三门峡市。现为西安电子科技大学博士研究生。主要研究方向为无线通信、具身智能和强化学习。E-mail: lzh7532022@163.com
孙雯 女,1987年12月出生于江西省南昌市。现为中兴通讯软件测试无线资深专家。主要研究方向为无线通信领域软件测试技术与质量保障。E-mail: sun.wen3@zte.com.cn
梁琳琳 男,1986年10月出生于河南省驻马店市。现任西安电子科技大学网络与信息安全学院副教授。主要研究方向为隐蔽通信、物联网应用与安全。E-mail: llliang@xidian.edu.cn
收稿:2026-04-23,
录用:2026-06-08,
纸质出版:2026-06-25
移动端阅览
齐佩汉, 刘智豪, 孙雯, 等. 通用知识与专用信息共驱动的具身智能抗干扰通信策略生成方法[J]. 电子学报, 2026, 54(06): 2727-2739.
QI Peihan, LIU Zhihao, SUN Wen, et al. Embodied Intelligent Anti-Jamming Communication Strategy Generation Method Co-Driven by General Knowledge and Specialized Information[J]. Acta Electronica Sinica, 2026, 54(06): 2727-2739.
齐佩汉, 刘智豪, 孙雯, 等. 通用知识与专用信息共驱动的具身智能抗干扰通信策略生成方法[J]. 电子学报, 2026, 54(06): 2727-2739. DOI:10.12263/DZXB.20260263
QI Peihan, LIU Zhihao, SUN Wen, et al. Embodied Intelligent Anti-Jamming Communication Strategy Generation Method Co-Driven by General Knowledge and Specialized Information[J]. Acta Electronica Sinica, 2026, 54(06): 2727-2739. DOI:10.12263/DZXB.20260263
随着新一代无线网络向通信、感知、计算一体化的复杂网络演进,通信设备呈现爆发式增长。海量设备的并发接入引发了激烈的频谱冲突,叠加开放信道下复杂多变的电磁干扰威胁,导致大规模网络协同通信困难。现有基于多智能体的抗干扰算法虽能缓解上述冲突,但其优化参数往往随智能体数量呈线性或指数级增加,庞大的训练开销与内存消耗使其难以实现大规模扩展。针对面临的协同困难与扩展性受限问题,提出了一种通用知识与专用信息共驱动的具身智能抗干扰通信策略生成方法。该方法通过参数共享策略构建统一的共享神经网络架构,将优化参数的增长与智能体数量相分离,在显著降低模型参数规模的同时提升系统的可扩展性。在此基础上,利用共享卷积神经网络(Convolutional Neural Network,CNN)对电磁环境进行特征提取,从原始频谱观测中学习可供所有智能体共同使用的通用知识表示。同时,为区分个体,方法进一步引入可学习的身份嵌入向量作为专用信息,并与通用知识进行联合建模,从而实现同质智能体的差异化决策,进而生成高效的协同抗干扰通信策略。仿真结果表明,该方法在固定干扰、扫频干扰和智能干扰场景下均具有显著优势,有效缓解了大规模抗干扰通信中的协同冲突,特别是在扫频干扰场景下,该方法的自适应通信效率(Self-Adaptive Communication Efficiency,SACE)较多智能体近端策略优化(Multi-Agent Proximal Policy Optimization,MAPPO)方法和独立DQN(Independent Deep Q-Network,IDQN)方法分别提升约22%和38%,验证了协同机制的高效性。此外,在不改变网络架构的前提下,针对不同规模的多信道多用户场景进行仿真实验验证,结果表明该方法能够稳定收敛并达到优异性能,具有良好的可扩展性。
As new-generation wireless networks evolve toward complex networks integrating communication
sensing
and computing
the number of communication devices is experiencing explosive growth. The concurrent access of massive devices triggers intense spectrum conflicts
which
compounded by complex and dynamic electromagnetic interference threats in open channels
leads to difficulties in collaborative communication within large-scale networks. Although existing multi-agent-based anti-jamming algorithms can alleviate these conflicts
their optimization parameters often increase linearly or exponentially with the number of agents
and the resulting massive training overhead and memory consumption make large-scale expansion difficult. To address the challenges of collaboration and limited scalability
this paper proposes an embodied intelligent anti-jamming communication strategy generation method co-driven by general knowledge and specific information. This method constructs a unified shared neural network architecture through a parameter-sharing strategy
decoupling the growth of optimization parameters from the number of agents
thereby significantly reducing the scale of model parameters while enhancing system scalability. On this basis
a shared convolutional neural network (CNN) is utilized to extract features from the electromagnetic environment
learning general knowledge representations from raw spectrum observations that are available to all agents. Meanwhile
to distinguish individuals
the method introduces learnable identity embedding vectors as specific information and performs joint modeling with general knowledge
thereby achieving differentiated decision-making for homogeneous agents and generating efficient collaborative anti-jamming communication strategies. Simulation results demonstrate that this method offers significant advantages in fixed jamming
sweep jamming
and intelligent jamming scenarios
effectively alleviating collaborative conflicts in large-scale anti-jamming communication; particularly in the sweep jamming scenario
the self-adaptive communication efficiency (SACE) of this method improves by approximately 22% and 38% compared to the multi-agent proximal policy optimization (MAPPO) method and the independent deep Q-network (IDQN) method
respectively
verifying the efficiency of the collaborative mechanism. Furthermore
simulation experiments on multi-channel multi-user scenarios of varying scales
conducted without altering the network architecture
show that the method achieves stable convergence and excellent performance
demonstrating good scalability.
王先梅 , 刘向博 , 任语铮 , 等 . 人工智能驱动的雷达通信一体化研究综述 [J ] . 雷达学报(中英文) , 2025 , 14 ( 4 ): 1071 - 1091 .
Wang Xianmei , Liu Xiangbo , Ren Yuzheng , et al . Review of research on artificial intelligence-driven joint radar communication [J ] . Journal of Radars , 2025 , 14 ( 4 ): 1071 - 1091 . (in Chinese)
Zhang Hao , Zhou Fuhui , Du Hongyang , et al . Revolution of wireless signal recognition for 6G: Recent advances, challenges and future directions [J ] . IEEE Communications Surveys & Tutorials , 2026 , 28 : 3521 - 3563 . DOI: 10.1109/comst.2025.3569427 http://dx.doi.org/10.1109/comst.2025.3569427
许辰人 , 马翔天 , 徐昊天 , 等 . 5G抗干扰技术综述 [J ] . 电子学报 , 2023 , 51 ( 3 ): 765 - 778 .
Xu Chenren , Ma Xiangtian , Xu Haotian , et al . A survey of 5G anti-interference technology [J ] . Acta Electronica Sinica , 2023 , 51 ( 3 ): 765 - 778 . (in Chinese)
宋佰霖 , 许华 , 蒋磊 , 等 . 一种基于深度强化学习的通信抗干扰智能决策方法 [J ] . 西北工业大学学报 , 2021 , 39 ( 3 ): 641 - 649 . DOI: 10.1051/JNWPU/20213930641 http://dx.doi.org/10.1051/JNWPU/20213930641
Song Bailin , Xu Hua , Jiang Lei , et al . An intelligent decision-making method for anti-jamming communication based on deep reinforcement learning [J ] . Journal of Northwestern Polytechnical University , 2021 , 39 ( 3 ): 641 - 649 . (in Chinese) . DOI: 10.1051/JNWPU/20213930641 http://dx.doi.org/10.1051/JNWPU/20213930641
凌耀 , 谢世珺 , 梁豪 , 等 . 基于多奖励值DDQN智能通信抗干扰决策方法 [J ] . 电讯技术 , 2025 , 65 ( 11 ): 1820 - 1827 .
Ling Yao , Xie Shijun , Liang Hao , et al . An intelligent communication anti-interference decision algorithm based on multiple reward value DDQN [J ] . Telecommunication Engineering , 2025 , 65 ( 11 ): 1820 - 1827 . (in Chinese)
潘筱茜 , 张姣 , 刘琰 , 等 . 基于深度强化学习的多域联合干扰规避 [J ] . 信号处理 , 2022 , 38 ( 12 ): 2572 - 2581 .
Pan Xiaoqian , Zhang Jiao , Liu Yan , et al . Multi-domain joint interference avoidance based on deep reinforcement learning [J ] . Journal of Signal Processing , 2022 , 38 ( 12 ): 2572 - 2581 . (in Chinese)
Zhang Zixuan , Wu Qinhao , Zhang Bo , et al . Intelligent anti-jamming relay communication system based on reinforcement learning [C ] // 2019 2nd International Conference on Communication Engineering and Technology (ICCET) . Piscataway : IEEE , 2019 : 52 - 56 . DOI: 10.1109/iccet.2019.8726916 http://dx.doi.org/10.1109/iccet.2019.8726916
Li Wen , Xu Yuhua , Chen Jin , et al . Know thy enemy: An opponent modeling-based anti-intelligent jamming strategy beyond equilibrium solutions [J ] . IEEE Wireless Communications Letters , 2023 , 12 ( 2 ): 217 - 221 . DOI: 10.1109/lwc.2022.3219434 http://dx.doi.org/10.1109/lwc.2022.3219434
Wang Haichao , Ding Guoru , Chen Jin , et al . UAV anti-jamming communications with power and mobility control [J ] . IEEE Transactions on Wireless Communications , 2023 , 22 ( 7 ): 4729 - 4744 . DOI: 10.1109/twc.2022.3228265 http://dx.doi.org/10.1109/twc.2022.3228265
Liu Xin , Xu Yuhua , Jia Luliang , et al . Anti-jamming communications using spectrum waterfall: A deep reinforcement learning approach [J ] . IEEE Communications Letters , 2018 , 22 ( 5 ): 998 - 1001 . DOI: 10.1109/lcomm.2018.2815018 http://dx.doi.org/10.1109/lcomm.2018.2815018
Li Yangyang , Xu Yuhua , Xu Yitao , et al . Dynamic spectrum anti-jamming in broadband communications: A hierarchical deep reinforcement learning approach [J ] . IEEE Wireless Communications Letters , 2020 , 9 ( 10 ): 1616 - 1619 . DOI: 10.1109/lwc.2020.2999333 http://dx.doi.org/10.1109/lwc.2020.2999333
Li Xiangchen , Chen Jienan , Ling Xiang , et al . Deep reinforcement learning-based anti-jamming algorithm using dual action network [J ] . IEEE Transactions on Wireless Communications , 2023 , 22 ( 7 ): 4625 - 4637 . DOI: 10.1109/twc.2022.3227575 http://dx.doi.org/10.1109/twc.2022.3227575
Li Yongcheng , Wang Jinchi , Gao Zhenzhen . Learning-based multi-domain anti-jamming communication with unknown information [J ] . Electronics , 2023 , 12 ( 18 ): 3901 . DOI: 10.3390/electronics12183901 http://dx.doi.org/10.3390/electronics12183901
王为念 , 苏健 , 陈勇 , 等 . 基于多智能体深度强化学习的车联网频谱共享 [J ] . 电子学报 , 2024 , 52 ( 5 ): 1690 - 1699 . DOI: 10.3390/fi16050152 http://dx.doi.org/10.3390/fi16050152
Wang Weinian , Su Jian , Chen Yong , et al . Multi-agent reinforcement learning enabled spectrum sharing for vehicular networks [J ] . Acta Electronica Sinica , 2024 , 52 ( 5 ): 1690 - 1699 . (in Chinese) . DOI: 10.3390/fi16050152 http://dx.doi.org/10.3390/fi16050152
韩光洁 , 朱胜超 , 林川 , 等 . 多智能体强化学习: 从基础理论到前沿算法 [J ] . 电子学报 , 2025 , 53 ( 12 ): 4756 - 4786 .
Han Guangjie , Zhu Shengchao , Lin Chuan , et al . Multi-agent reinforcement learning: From foundational theory to cutting-edge algorithms [J ] . Acta Electronica Sinica , 2025 , 53 ( 12 ): 4756 - 4786 . (in Chinese)
Zhou Quan , Li Yonggui , Niu Yingtao . Intelligent anti-jamming communication for wireless sensor networks: A multi-agent reinforcement learning approach [J ] . IEEE Open Journal of the Communications Society , 2021 , 2 : 775 - 784 . DOI: 10.1109/ojcoms.2021.3056113 http://dx.doi.org/10.1109/ojcoms.2021.3056113
陈平平 , 张旭 , 谢肇鹏 , 等 . 基于多智能体近端策略优化的多信道动态频谱接入 [J ] . 电子学报 , 2024 , 52 ( 6 ): 1824 - 1831 .
Chen Pingping , Zhang Xu , Xie Zhaopeng , et al . Multi-channel dynamic spectrum access based on multi-agent proximal policy optimization [J ] . Acta Electronica Sinica , 2024 , 52 ( 6 ): 1824 - 1831 . (in Chinese)
Zhou Quan , Niu Yingtao , Xiang Peng , et al . Intra-domain knowledge reuse assisted reinforcement learning for fast anti-jamming communication [J ] . IEEE Transactions on Information Forensics and Security , 2023 , 18 : 4707 - 4720 . DOI: 10.1109/tifs.2023.3284611 http://dx.doi.org/10.1109/tifs.2023.3284611
Zhang Xiaobo , Wang Hai , Ruan Lang , et al . Joint channel and power optimisation for multi-user anti-jamming communications: A dual mode Q-learning approach [J ] . IET Communications , 2022 , 16 ( 6 ): 619 - 633 . DOI: 10.1049/cmu2.12339 http://dx.doi.org/10.1049/cmu2.12339
Shan Qiucheng , Xiong Jun , Ma Dongtang , et al . Distributed multi-agent Q-learning for anti-dynamic jamming and collision-avoidance spectrum access in cognitive radio system [C ] // 2018 24th Asia-Pacific Conference on Communications (APCC) . Piscataway : IEEE , 2018 : 428 - 432 . DOI: 10.1109/apcc.2018.8633463 http://dx.doi.org/10.1109/apcc.2018.8633463
Pourranjbar A , Kaddoum G , Ferdowsi A , et al . Reinforcement learning for deceiving reactive jammers in wireless networks [J ] . IEEE Transactions on Communications , 2021 , 69 ( 6 ): 3682 - 3697 . DOI: 10.1109/tcomm.2021.3062854 http://dx.doi.org/10.1109/tcomm.2021.3062854
Yao Fuqiang , Jia Luliang . A collaborative multi-agent reinforcement learning anti-jamming algorithm in wireless networks [J ] . IEEE Wireless Communications Letters , 2019 , 8 ( 4 ): 1024 - 1027 . DOI: 10.1109/lwc.2019.2904486 http://dx.doi.org/10.1109/lwc.2019.2904486
Lv Zefang , Xiao Liang , Du Yousong , et al . Multi-agent reinforcement learning based UAV swarm communications against jamming [J ] . IEEE Transactions on Wireless Communications , 2023 , 22 ( 12 ): 9063 - 9075 . DOI: 10.1109/twc.2023.3268082 http://dx.doi.org/10.1109/twc.2023.3268082
Elleuch I , Pourranjbar A , Kaddoum G . Deep cross-check Q-learning for jamming mitigation in wireless networks [J ] . IEEE Wireless Communications Letters , 2024 , 13 ( 5 ): 1448 - 1452 . DOI: 10.1109/lwc.2024.3374215 http://dx.doi.org/10.1109/lwc.2024.3374215
Jing Xiaorong , Wang Rui , Lei Hongjiang , et al . Multi-agent discrete soft actor-critic algorithm-based multi-user collaborative anti-jamming strategy [J ] . IEEE Transactions on Information Forensics and Security , 2025 , 20 : 5025 - 5038 . DOI: 10.1109/tifs.2025.3570160 http://dx.doi.org/10.1109/tifs.2025.3570160
Xu Yifan , Chen Jin , Feng Zhibin , et al . Hierarchical coordinated anti-jamming channel access in clustering networks: A multi-leader multi-follower Stackelberg game approach [J ] . EURASIP Journal on Advances in Signal Processing , 2021 , 2021 ( 1 ): 42 . DOI: 10.1186/s13634-021-00764-0 http://dx.doi.org/10.1186/s13634-021-00764-0
Goldsmith A . Wireless communications [M ] . Cambridge : Cambridge University Press , 2005 . DOI: 10.1037/e515962006-018 http://dx.doi.org/10.1037/e515962006-018
Rappaport T S . Wireless communications: Principles and practice [M ] . 2nd ed . Upper Saddle River : Prentice Hall , 2002 .
Schulman J , Moritz P , Levine S , et al . High-dimensional continuous control using generalized advantage estimation [PP/OL ] . V6. arXiv ( 2018-10-20 )[ 2026-01-03 ] . https://arxiv.org/abs/1506.02438 https://arxiv.org/abs/1506.02438 .
Schulman J , Wolski F , Dhariwal P , et al . Proximal policy optimization algorithms [PP/OL ] . V2. arXiv ( 2017-08-28 )[ 2026-01-03 ] . https://arxiv.org/abs/1707.06347 https://arxiv.org/abs/1707.06347 .
Yang Ning , Zhang Haijun , Berry R . Partially observable multi-agent deep reinforcement learning for cognitive resource management [C ] // GLOBECOM 2020 - 2020 IEEE Global Communications Conference . Piscataway : IEEE , 2020 : 1 - 6 . DOI: 10.1109/globecom42002.2020.9322150 http://dx.doi.org/10.1109/globecom42002.2020.9322150
Zhang Feng , Niu Yingtao , Zhou Wenhao . Intelligent anti-jamming decision algorithm for wireless communication based on MAPPO [J ] . Electronics , 2025 , 14 ( 3 ): 462 . DOI: 10.3390/electronics14030462 http://dx.doi.org/10.3390/electronics14030462
0
浏览量
128
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621