论文标题

VHR遥感图像中用于变化检测的双邻域超图神经网络

A Dual Neighborhood Hypergraph Neural Network for Change Detection in VHR Remote Sensing Images

论文作者

Wu, Junzheng, Fu, Ruigang, Liu, Qiang, Ni, Weiping, Cheng, Kenan, Li, Biao, Sun, Yuli

论文摘要

非常高的空间分辨率(VHR)遥感图像已成为监测变化的极为有价值的来源。但是,由于地面对象之间关系的复杂性,精确检测VHR图像的相关变化仍然是一个挑战。为了解决这一限制,本文提出了双重邻域功能超图神经网络,该网络结合了多尺度超像素细分和超图卷积,以建模和利用复杂的关系。首先,将双颞图像对分割在两个尺度下,并馈入预训练的U-NET,以通过将每个对象的细度将每个对象视为节点,从而获得节点特征。然后,使用分段对象的父子和相邻关系来定义双邻域以构建超图,这允许模型代表高阶结构化信息,远比成对关系更为复杂。在构造的超图上进行了超弹力卷积,以通过节点边缘节点变换从少量标记的节点传播标签信息到其他未标记的节点。此外,为了减轻样本不平衡的问题,采用了局灶性损失函数来训练HyperGraph神经网络。与许多最新方法相比,有关光学,SAR和异质光学/SAR数据集的实验结果表明,所提出的方法包括更好的有效性和鲁棒性。

The very high spatial resolution (VHR) remote sensing images have been an extremely valuable source for monitoring changes occurred on the earth surface. However, precisely detecting relevant changes in VHR images still remains a challenge, due to the complexity of the relationships among ground objects. To address this limitation, a dual neighborhood hypergraph neural network is proposed in this article, which combines the multiscale superpixel segmentation and hypergraph convolution to model and exploit the complex relationships. First, the bi-temporal image pairs are segmented under two scales and fed to a pre-trained U-net to obtain node features by treating each object under the fine scale as a node. The dual neighborhood is then defined using the father-child and adjacent relationships of the segmented objects to construct the hypergraph, which permits models to represent the higher-order structured information far more complex than just pairwise relationships. The hypergraph convolutions are conducted on the constructed hypergraph to propagate the label information from a small amount of labeled nodes to the other unlabeled ones by the node-edge-node transform. Moreover, to alleviate the problem of imbalanced sample, the focal loss function is adopted to train the hypergraph neural network. The experimental results on optical, SAR and heterogeneous optical/SAR data sets demonstrate that the proposed method comprises better effectiveness and robustness compared to many state-of-the-art methods.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源