论文标题

及时限制的边缘学习:挑战和解决方案

Edge Learning with Timeliness Constraints: Challenges and Solutions

论文作者

Sun, Yuxuan, Shi, Wenqi, Huang, Xiufeng, Zhou, Sheng, Niu, Zhisheng

论文摘要

未来的机器学习(ML)动力应用程序,例如自动驾驶和增强现实,涉及及时性要求的培训和推理任务,并且是沟通和计算密集型的,这需要边缘学习框架。实时要求驱使我们超越了ML的准确性。在本文中,我们介绍了及时的边缘学习概念,旨在实现准确的培训和推断,同时最大程度地减少沟通和计算延迟。我们讨论关键挑战,并从数据,模型和资源管理角度提出相应的解决方案,以满足及时性要求。特别是,对于边缘培训,我们认为应考虑总训练延迟而不是回合,并提出数据或模型压缩,以及集中式培训和联合学习系统的联合设备调度和资源管理方案。对于边缘推理,我们探讨了通信和计算的准确性和延迟之间的依赖性,并提出了动态数据压缩和灵活的修剪方案。两项案例研究表明,及时性能,包括在给定延迟预算下的训练准确性以及截止日期内推理任务的完成比,这是通过提议的解决方案的高度提高的。

Future machine learning (ML) powered applications, such as autonomous driving and augmented reality, involve training and inference tasks with timeliness requirements and are communication and computation intensive, which demands for the edge learning framework. The real-time requirements drive us to go beyond accuracy for ML. In this article, we introduce the concept of timely edge learning, aiming to achieve accurate training and inference while minimizing the communication and computation delay. We discuss key challenges and propose corresponding solutions from data, model and resource management perspectives to meet the timeliness requirements. Particularly, for edge training, we argue that the total training delay rather than rounds should be considered, and propose data or model compression, and joint device scheduling and resource management schemes for both centralized training and federated learning systems. For edge inference, we explore the dependency between accuracy and delay for communication and computation, and propose dynamic data compression and flexible pruning schemes. Two case studies show that the timeliness performances, including the training accuracy under a given delay budget and the completion ratio of inference tasks within deadline, are highly improved with the proposed solutions.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源