面向公平性数据采集和能量补充的无人机路径规划算法研究

高思华; 李军辉; 李建伏; 刘宝煜

doi:10.12263/DZXB.20230299

您当前的位置：

首页 >

文章列表页 >

面向公平性数据采集和能量补充的无人机路径规划算法研究

学术论文 | 更新时间：2025-12-11

- 面向公平性数据采集和能量补充的无人机路径规划算法研究
- Research on UAV Path Planning Algorithm for Fairness Data Collection and Energy Supplement
- 电子学报 2024年52卷第11期页码：3699-3710
- 作者机构：
  
  中国民航大学计算机科学与技术学院，天津 300300
- 作者简介：
  
  [ "高思华男，1987年出生，河北承德人.现为中国民航大学讲师、硕士生导师.主要研究方向为强化学习理论、最优化理论、无线传感器网络和无人机系统. E-mail: shgao@cauc.edu.cn" ]
  [ "李军辉男，1996年出生，安徽阜阳人.现为中国民航大学计算机科学与技术学院硕士研究生.主要研究方向为强化学习理论、无人机路径规划. E-mail: li2531512787@163.com" ]
  [ "李建伏女，1979年出生，河北沧州人.现为中国民航大学计算机科学与技术学院副教授、硕士生导师.主要研究方向为深度学习、机器学习、推荐技术及应用. E-mail: jfli@cauc.edu.cn" ]
  [ "刘宝煜男，1999年出生，河南漯河人.现为中国民航大学计算机科学与技术学院硕士研究生.主要研究方向为强化学习理论、无人机路径规划. E-mail: by_liu529@163.com" ]
- 基金信息：
  
  国家自然科学基金(62173332);中央高校基本科研业务费专项资金(3122019118)
- DOI：10.12263/DZXB.20230299
  中图分类号： TP393
- 收稿：2023-04-04，
  
  修回：2024-05-12，
  
  纸质出版：2024-11-25
- 稿件说明：
移动端阅览
高思华, 李军辉, 李建伏, 等. 面向公平性数据采集和能量补充的无人机路径规划算法研究[J]. 电子学报, 2024, 52(11): 3699-3710.

GAO Si-hua, LI Jun-hui, LI Jian-fu, et al. Research on UAV Path Planning Algorithm for Fairness Data Collection and Energy Supplement[J]. Acta Electronica Sinica, 2024, 52(11): 3699-3710.
高思华, 李军辉, 李建伏, 等. 面向公平性数据采集和能量补充的无人机路径规划算法研究[J]. 电子学报, 2024, 52(11): 3699-3710. DOI：10.12263/DZXB.20230299

GAO Si-hua, LI Jun-hui, LI Jian-fu, et al. Research on UAV Path Planning Algorithm for Fairness Data Collection and Energy Supplement[J]. Acta Electronica Sinica, 2024, 52(11): 3699-3710. DOI：10.12263/DZXB.20230299

摘要

针对无人机（Unmanned Aerial Vehicle，UAV）辅助WSN（Wireless Sensor Networks）数据采集和能量补充工作中存在的数据来源单一和能量补充不均衡现象，本文首先提出数据采集和能量补充公平性问题并进行数学建模.其次，本文设计一种DPDQN（Double Parametrized Deep Q-Networks）强化学习算法，规划无人机的飞行路线和悬停位置，优化数据采集和能量补充效果.DPDQN学习离散动作与多种连续动作相混合的动作选择策略，算法网络模型包括离散动作网络和连续动作网络两部分.前者规划无人机访问数据采集节点的顺序，后者优化无人机在数据采集节点周围的悬停位置.仿真实验结果显示，本文算法在数据采集公平性、能量补充公平性、飞行距离和四种影响公平性的因素比较中均优于三种现有对比算法，并具有良好的鲁棒性和稳定性.

Abstract

UAV (Unmanned Aerial Vehicle)-assisted WSN (Wireless Sensor Networks) suffers from single-source data collection and uneven energy supplement. In this article

we first investigate and develop a mathematical model for the problem of fairness for data collection and energy supplement. Then

a novel deep reinforcement learning algorithm

named DPDQN (Double Parametrized Deep Q-Networks)

is designed to resolve the proposed problem. The DPDQN algorithm incorporates a hybrid discrete-continuous action strategy

which consists of two components

namely

discrete action network and continuous action network. The former schedules the UAV's visiting order to sensors in WSN

and the latter optimizes the UAV’s hover position around each visited sensor. Numerical results demonstrate that the DPDQN algorithm outperforms three existing solutions in data collection fairness

energy replenishment fairness

flying distance

and four factors that influence fairness. Furthermore

the results validate our algorithm is robust and stable.

关键词

Keywords

references

AKYILDIZ I F , SU W , SANKARASUBRAMANIAM Y , et al . Wireless sensor networks: A survey [J ] . Computer Networks , 2002 , 38 ( 4 ): 393 - 422 .

RAWAT P , SINGH K D , CHAOUCHI H , et al . Wireless sensor networks: A survey on recent developments and potential synergies [J ] . The Journal of Supercomputing , 2014 , 68 : 1 - 48 .

LAI X , JI X , ZHOU X , et al . Energy efficient link-delay aware routing in wireless sensor networks [J ] . IEEE Sensors Journal , 2017 , 18 ( 2 ): 837 - 848 .

LI X , LI D , WAN J , et al . A review of industrial wireless networks in the context of Industry 4.0 [J ] . Wireless networks , 2017 , 23 : 23 - 41 .

FANG Q , PAN J , CHEN Y , et al . Construction of the supply chain of live streaming e-commerce based on blockchain and internet of things [C ] // 2022 International Conference on Bigdata Blockchain and Economy Management (ICBBEM 2022) . Dordrecht : Atlantis Press , 2022 : 526 - 540 .

LI J , HAN Q , WANG W . Characteristics analysis and suppression strategy of energy hole in wireless sensor networks [J ] . Ad Hoc Networks , 2022 , 135 : 102938 .

CICEK C T , SHEN Z J M , GULTEKIN H , et al . 3-D dynamic UAV base station location problem [J ] . INFORMS Journal on Computing , 2021 , 33 ( 3 ): 839 - 860 .

BLISS M , MICHELUSI N . Adaptive scheduling and trajectory design for power-constrained wireless UAV relays [EB/OL ] . ( 2023-02-05 )[ 2023-04-02 ] . https://arxiv.org/pdf/2007.01228.pdf https://arxiv.org/pdf/2007.01228.pdf .

GUO H , LIU J . UAV-enhanced intelligent offloading for Internet of Things at the edge [J ] . IEEE Transactions on Industrial Informatics , 2019 , 16 ( 4 ): 2737 - 2746 .

YE Z , WANG K , CHEN Y , et al . Multi-UAV navigation for partially observable communication coverage by graph reinforcement learning [J ] . IEEE Transactions on Mobile Computing , 2022 .

WANG B , ZHANG R , CHEN C , et al . Graph-based file dispatching protocol with D2D-enhanced UAV-NOMA communications in large-scale networks [J ] . IEEE Internet of Things Journal , 2020 , 7 ( 9 ): 8615 - 8630 .

KUMAR S , RATHORE N K , PRAJAPATI M , et al . SF-GoeR: An emergency information dissemination routing in flying ad-hoc network to support healthcare monitoring [J ] . Journal of Ambient Intelligence and Humanized Computing , 2023 , 14 ( 7 ): 9343 - 9353 .

BAEK J , HAN S I , HAN Y . Optimal UAV route in wireless charging sensor networks [J ] . IEEE Internet of Things Journal , 2019 , 7 ( 2 ): 1327 - 1335 .

QIAN L P , ZHANG H , WANG Q , et al . Joint multi-domain resource allocation and trajectory optimization in UAV-assisted maritime IoT networks [J ] . IEEE Internet of Things Journal , 2022 , 10 ( 1 ): 539 - 552 .

HU H , XIONG K , QU G , et al . AoI-minimal trajectory planning and data collection in UAV-assisted wireless powered IoT networks [J ] . IEEE Internet of Things Journal , 2020 , 8 ( 2 ): 1211 - 1223 .

BENMAD I , DRIOUCH E , KARDOUCHI M . Data collection in UAV-assisted wireless sensor networks powered by harvested energy [C ] // 2021 IEEE 32nd Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) . Piscataway : IEEE , 2021 : 1351 - 1356 .

LIU Y , XIONG K , LU Y , et al . UAV-aided wireless power transfer and data collection in Rician fading [J ] . IEEE Journal on Selected Areas in Communications , 2021 , 39 ( 10 ): 3097 - 3113 .

黄晓舸 , 何勇 , 陈前斌 , 等 . 无人机群辅助的数据采集能耗优化方法 [J ] . 电子与信息学报 , 2023 , 45 ( 6 ): 2054 - 2062 .

HUANG X G , HE Y , CHEN Q B , et al . Optimization method for energy consumption in data acquisition assisted by UAV swarms [J ] . Journal of Electronics & Information Technology , 2023 , 45 ( 6 ): 2054 - 2062 . (in Chinese)

FU S , TANG Y , WU Y , et al . Energy-efficient UAV-enabled data collection via wireless charging: A reinforcement learning approach [J ] . IEEE Internet of Things Journal , 2021 , 8 ( 12 ): 10209 - 10219 .

刘全 , 翟建伟 , 章宗长 , 等 . 深度强化学习综述 [J ] . 计算机学报 , 2018 , 41 ( 1 ): 1 - 27 .

LIU Q , ZHAI J W , ZHANG Z Z , et al . A survey on deep reinforcement learning [J ] . Chinese Journal of Computers , 2018 , 41 ( 1 ): 1 - 27 . (in Chinese)

LI K , NI W , TOVAR E , et al . On-board deep Q-network for UAV-assisted online power transfer and data collection [J ] . IEEE Transactions on Vehicular Technology , 2019 , 68 ( 12 ): 12215 - 12226 .

ZHANG J , YU Y , WANG Z , et al . Trajectory planning of UAV in wireless powered IoT system based on deep reinforcement learning [C ] // 2020 IEEE/CIC International Conference on Communications in China (ICCC) . Piscataway : IEEE , 2020 : 645 - 650 .

SUN M , XU X , QIN X , et al . AoI-energy-aware UAV-assisted data collection for IoT networks: A deep reinforcement learning method [J ] . IEEE Internet of Things Journal , 2021 , 8 ( 24 ): 17275 - 17289 .

ZHANG Z , XU C , LI Z , et al . Deep reinforcement learning for aerial data collection in hybrid-powered noma-iot networks [J ] . IEEE Internet of Things Journal , 2022 , 10 ( 2 ): 1761 - 1774 .

YU Y , TANG J , HUANG J , et al . Multi-objective optimization for UAV-assisted wireless powered IoT networks based on extended DDPG algorithm [J ] . IEEE Transactions on Communications , 2021 , 69 ( 9 ): 6361 - 6374 .

XIONG J , WANG Q , YANG Z , et al . Parametrized deep q-networks learning: Reinforcement learning with discrete-continuous hybrid action space [EB/OL ] . ( 2018-10-10 )[ 2023-04-02 ] . https://arxiv.org/pdf/1810.06394.pdf https://arxiv.org/pdf/1810.06394.pdf .

ZENG Y , XU J , ZHANG R . Energy minimization for wireless communication with rotary-wing UAV [J ] . IEEE Transactions on Wireless Communications , 2019 , 18 ( 4 ): 2329 - 2345 .

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于因果思维树的电动汽车电池SOC预测模型

车联网边缘计算环境下基于流量预测的高效任务卸载策略研究

基于多智能体近端策略优化的多信道动态频谱接入

基于多智能体深度强化学习的车联网频谱共享