论文标题
使用加固学习的目标导向图形构建
Goal-directed graph construction using reinforcement learning
论文作者
论文摘要
图形可用于表示和理由,并设计了各种指标来量化其全局特征。但是,目前对如何构建图形或改进目标目标的现有图表知之甚少。在这项工作中,我们将图形的构造作为决策过程,在该过程中,中央代理商通过反复试验创建拓扑,并获得与目标目标价值成正比的奖励。通过这个概念框架,我们提出了一种基于强化学习和图形神经网络的算法,以学习图形结构和改进策略。我们的核心案例研究集中于对失败和攻击的鲁棒性,这是一种与现代社会供电的基础设施和通信网络相关的财产。关于合成和现实世界图的实验表明,这种方法可以胜过现有的方法,而评估则更便宜。在某些情况下,它还允许概括到样本外图以及较大的分布图。该方法适用于优化图形的其他全局结构特性。
Graphs can be used to represent and reason about systems and a variety of metrics have been devised to quantify their global characteristics. However, little is currently known about how to construct a graph or improve an existing one given a target objective. In this work, we formulate the construction of a graph as a decision-making process in which a central agent creates topologies by trial and error and receives rewards proportional to the value of the target objective. By means of this conceptual framework, we propose an algorithm based on reinforcement learning and graph neural networks to learn graph construction and improvement strategies. Our core case study focuses on robustness to failures and attacks, a property relevant for the infrastructure and communication networks that power modern society. Experiments on synthetic and real-world graphs show that this approach can outperform existing methods while being cheaper to evaluate. It also allows generalization to out-of-sample graphs, as well as to larger out-of-distribution graphs in some cases. The approach is applicable to the optimization of other global structural properties of graphs.