论文标题

PGX:基于不同知识蒸馏过程的多级GNN解释框架

PGX: A Multi-level GNN Explanation Framework Based on Separate Knowledge Distillation Processes

论文作者

Bui, Tien-Cuong, Li, Wen-syan, Cha, Sang-Kyun

论文摘要

图形神经网络(GNN)在高级AI系统中被广泛采用,因为它们在图形数据上的表示能力。即使GNN的解释对于增加对系统的信任至关重要,但由于GNN执行的复杂性,它也是一项挑战。最近,已经提出了许多著作来解决GNN解释中的一些问题。但是,当图形的尺寸巨大时,它们缺乏概括能力或计算负担。为了应对这些挑战,我们提出了一个多级GNN解释框架,基于观察到GNN是图形数据中多个组件的多模式学习过程。原始问题的复杂性是通过分解为表示为层次结构的多个子部分来放松的。顶级解释旨在指定每个组件对模型执行和预测的贡献,而细粒度的级别则集中于基于知识蒸馏的特征归因和图形结构归因分析。学生模型以独立模式进行了培训,并负责捕获不同的教师行为,后来用于特定的组件解释。此外,我们还旨在实现个性化的解释,因为该框架可以根据用户偏好产生不同的结果。最后,广泛的实验证明了我们提出的方法的有效性和保真度。

Graph Neural Networks (GNNs) are widely adopted in advanced AI systems due to their capability of representation learning on graph data. Even though GNN explanation is crucial to increase user trust in the systems, it is challenging due to the complexity of GNN execution. Lately, many works have been proposed to address some of the issues in GNN explanation. However, they lack generalization capability or suffer from computational burden when the size of graphs is enormous. To address these challenges, we propose a multi-level GNN explanation framework based on an observation that GNN is a multimodal learning process of multiple components in graph data. The complexity of the original problem is relaxed by breaking into multiple sub-parts represented as a hierarchical structure. The top-level explanation aims at specifying the contribution of each component to the model execution and predictions, while fine-grained levels focus on feature attribution and graph structure attribution analysis based on knowledge distillation. Student models are trained in standalone modes and are responsible for capturing different teacher behaviors, later used for particular component interpretation. Besides, we also aim for personalized explanations as the framework can generate different results based on user preferences. Finally, extensive experiments demonstrate the effectiveness and fidelity of our proposed approach.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源