论文标题

深入增强学习基于超级可靠的低延迟通信的大规模访问管理

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

论文作者

Yang, Helin, Xiong, Zehui, Zhao, Jun, Niyato, Dusit, Yuen, Chau, Deng, Ruilong

论文摘要

随着物联网(IoT)的迅速部署,需要在有限的无线电频谱广播中大量访问大量设备。在无线网络中,不同的设备具有各种服务质量(QoS)要求,范围从可靠的低潜伏期通信(URLLC)到高传输数据速率。在这种情况下,我们提出了一种共同的节能亚渠道分配和电力控制方法,以管理大规模访问请求,同时最大化网络能效(EE)并保证不同的QoS要求。延迟约束转换为数据速率约束,该数据速率约束在将其建模为多代理增强学习问题之前,可以使优化问题进行处理。在大规模访问方案中,提出了基于深入增强学习(DRL)的分布式合作大规模访问方法(DRL),同时满足urllc服务的可靠性和延迟约束。此外,采用转移学习和合作学习机制来启用以分布式方式合作的沟通链接,从而提高网络性能并访问成功概率。仿真结果清楚地表明,在满足EE和提高大规模访问方案中的传输成功概率方面,所提出的分布式合作学习方法优于其他现有方法。

With the rapid deployment of the Internet of Things (IoT), fifth-generation (5G) and beyond 5G networks are required to support massive access of a huge number of devices over limited radio spectrum radio. In wireless networks, different devices have various quality-of-service (QoS) requirements, ranging from ultra-reliable low latency communications (URLLC) to high transmission data rates. In this context, we present a joint energy-efficient subchannel assignment and power control approach to manage massive access requests while maximizing network energy efficiency (EE) and guaranteeing different QoS requirements. The latency constraint is transformed into a data rate constraint which makes the optimization problem tractable before modelling it as a multi-agent reinforcement learning problem. A distributed cooperative massive access approach based on deep reinforcement learning (DRL) is proposed to address the problem while meeting both reliability and latency constraints on URLLC services in massive access scenario. In addition, transfer learning and cooperative learning mechanisms are employed to enable communication links to work cooperatively in a distributed manner, which enhances the network performance and access success probability. Simulation results clearly show that the proposed distributed cooperative learning approach outperforms other existing approaches in terms of meeting EE and improving the transmission success probability in massive access scenario.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源