论文标题

MACC:跨层多代理交通拥堵控制,并进行深入增强学习

MACC: Cross-Layer Multi-Agent Congestion Control with Deep Reinforcement Learning

论文作者

Bai, Jianing, Zhang, Tianhao, Xie, Guangming

论文摘要

拥堵控制(CC)是有效利用网络容量的核心网络任务,受到了极大的关注,并广泛用于各种Internet通信应用程序,例如5G,THIONTINT,UAN,UAN等。已经在网络和传输层上提出了各种CC算法,例如主动队列管理(AQM)算法和传输控制协议(TCP)拥塞控制机制。但是,很难对动态AQM/TCP系统进行建模并配合两种算法以在不同的通信方案下获得出色的性能。在本文中,我们探讨了基于多代理增强学习的跨层拥塞控制算法的性能以及两种代理(称为MACC(多代理拥塞控制))的合作绩效。我们在NS3中实现MACC。仿真结果表明,我们的方案在吞吐量和延迟等方面优于其他拥塞控制组合。不仅证明了基于多代理深度强化学习的网络协议对于通信管理有效,而且还可以验证网络领域可以用作机器学习算法的新游乐场。

Congestion Control (CC), as the core networking task to efficiently utilize network capacity, received great attention and widely used in various Internet communication applications such as 5G, Internet-of-Things, UAN, and more. Various CC algorithms have been proposed both on network and transport layers such as Active Queue Management (AQM) algorithm and Transmission Control Protocol (TCP) congestion control mechanism. But it is hard to model dynamic AQM/TCP system and cooperate two algorithms to obtain excellent performance under different communication scenarios. In this paper, we explore the performance of multi-agent reinforcement learning-based cross-layer congestion control algorithms and present cooperation performance of two agents, known as MACC (Multi-agent Congestion Control). We implement MACC in NS3. The simulation results show that our scheme outperforms other congestion control combination in terms of throughput and delay, etc. Not only does it proves that networking protocols based on multi-agent deep reinforcement learning is efficient for communication managing, but also verifies that networking area can be used as new playground for machine learning algorithms.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源