高级检索+

无人机辅助智能交通系统中基于C-DQN的信息年龄最小化研究

Research on Age of Information Minimization Based on C-DQN in UAV Assisted Intelligent Transportation System

  • 摘要: 无人机(Unmanned Aerial Vehicle, UAV)由于高机动性和低运营成本的优势,有望在未来智能交通系统(Intelligent Transportation System, ITS)中被部署为车辆数据收集器。为了保证所采集数据的时效性,以信息年龄(Age of Information, AoI)来衡量无人机从车辆接收到的数据的新鲜度。因此,提出一种基于信息年龄最小化的无人机辅助智能交通系统方案,通过联合优化无人机轨迹和无人机与车辆的关联策略,最小化所有车辆的信息年龄加权和。将该优化问题建模为一个马尔可夫决策过程(Markov Decision Process,MDP),并采用Curiosity-Driven Deep Q-learning Network(C-DQN)算法来求解。大量仿真结果表明,该算法在探索能力和收益性能方面优于传统Deep Q-learning Network(DQN)算法。

     

    Abstract: Unmanned aerial vehicle(UAV) have the potential to be deployed as vehicle data collectors in future intelligent transportation systems(ITS) due to their high maneuverability and low operational costs. To ensure the timeliness of the collected data, the freshness of the data received by UAVs from vehicles is measured in terms of age of information(AoI). Therefore, this paper proposes a UAVassisted ITS scheme based on minimizing the Age of Information, by jointly optimizing the UAV’s trajectory and the association strategy between the UAV and vehicles, to minimize the weighted sum of AoI for all vehicles. The optimization problem is modeled as a MARKOV decision process(MDP), and the curiosity-driven deep Q-learning network(C-DQN) algorithm is employed to solve it. Extensive simulation results demonstrate that this algorithm outperforms the traditional deep Q-learning network(DQN) algorithm in terms of exploration capability and performance gain.

     

/

返回文章
返回