UAV Frequency-based Crowdsensing Using Grouping Multi-agent Deep Reinforcement Learning

查看全文 作　　者：Cui [1]ZHANG;En [1]WANG;Funing [1]YANG;Yong jian [1]YANG;Nan [2]JIANG 机构地区：[1]College of Computer Science and Technology,Jilin University,Changchun 130012,China;[2]College of Information Engineering,East China Jiaotong University,Nanchang 330013,China 出　　处：《计算机科学》索引2023年第50卷第2期,共12页 基　　金：supported by the Innovation Capacity Construction Project of Jilin Development and Reform Commission(2020C017-2);Science and Technology Development Plan Project of Jilin Province(20210201082GX)。 摘　　要：Mobile CrowdSensing(MCS)is a promising sensing paradigm that recruits users to cooperatively perform sensing tasks.Recently,unmanned aerial vehicles(UAVs)as the powerful sensing devices are used to replace user participation and carry out some special tasks,such as epidemic monitoring and earthquakes rescue.In this paper,we focus on scheduling UAVs to sense the task Point-of-Interests(PoIs)with different frequency coverage requirements.To accomplish the sensing task,the scheduling strategy needs to consider the coverage requirement,geographic fairness and energy charging simultaneously.We consider the complex interaction among UAVs and propose a grouping multi-agent deep reinforcement learning approach(G-MADDPG)to schedule UAVs distributively.G-MADDPG groups all UAVs into some teams by a distance-based clustering algorithm(DCA),then it regards each team as an agent.In this way,G-MADDPG solves the problem that the training time of traditional MADDPG is too long to converge when the number of UAVs is large,and the trade-off between training time and result accuracy could be controlled flexibly by adjusting the number of teams.Extensive simulation results show that our scheduling strategy has better performance compared with three baselines and is flexible in balancing training time and result accuracy. 关 键 词：UAV Crowdsensing Frequency coverage Grouping multi-agent deep reinforcement learning