论文标题

深入攻击深度强化学习

Deep-Attack over the Deep Reinforcement Learning

论文作者

Li, Yang, Pan, Quan, Cambria, Erik

论文摘要

最近的对抗攻击发展使强化学习变得更加脆弱,并且存在着不同的方法来对其进行攻击,其中关键是如何选择攻击的正确时机。某些工作试图设计攻击评估功能,以选择如果值大于某个阈值,则将攻击。这种方法使得在不考虑长期影响的情况下很难找到适当的部署攻击的地方。此外,在攻击过程中缺乏适当的评估指标。为了使攻击更加聪明,并纠正了现有问题,我们通过自发考虑的有效性和偷偷摸摸地提出了基于增强学习的攻击框架,同时我们也提出了一个新的指标来评估这两个方面的攻击模型的性能。实验结果显示了我们提出的模型的有效性以及我们提出的评估度量的良好性。此外,我们验证了模型的可传递性及其在对抗训练下的鲁棒性。

Recent adversarial attack developments have made reinforcement learning more vulnerable, and different approaches exist to deploy attacks against it, where the key is how to choose the right timing of the attack. Some work tries to design an attack evaluation function to select critical points that will be attacked if the value is greater than a certain threshold. This approach makes it difficult to find the right place to deploy an attack without considering the long-term impact. In addition, there is a lack of appropriate indicators of assessment during attacks. To make the attacks more intelligent as well as to remedy the existing problems, we propose the reinforcement learning-based attacking framework by considering the effectiveness and stealthy spontaneously, while we also propose a new metric to evaluate the performance of the attack model in these two aspects. Experimental results show the effectiveness of our proposed model and the goodness of our proposed evaluation metric. Furthermore, we validate the transferability of the model, and also its robustness under the adversarial training.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源