论文标题
基于语义互动信息和拓扑结构的多频Polsar图像融合分类
Multi-frequency PolSAR Image Fusion Classification Based on Semantic Interactive Information and Topological Structure
论文作者
论文摘要
与单频度多极化SAR图像分类技术的快速发展相比,对多频偏光SAR(MF-POLSAR)图像的土地覆盖分类的研究更少。此外,当前用于MF-POLSAR分类的深度学习方法主要基于卷积神经网络(CNN),仅考虑局部空间性,但非本地关系被忽略了。因此,基于语义相互作用和非局部拓扑结构,本文提出了MF语义和拓扑融合网络(MF-STFNET),以提高MF-Polsar分类性能。在MF-STFNET中,为每个频段(基于语义信息)(SIC)和基于拓扑属性(TPC)实现了两种分类。他们在MF-STFNET培训期间进行协作,这不仅可以完全利用乐队的互补性,而且还可以结合本地和非本地空间信息以改善不同类别之间的歧视。对于SIC,设计了设计的跨带交互式提取模块(CIFEM),以明确对频段之间的深层语义相关性进行建模,从而利用频带的互补性使地面对象更可分开。对于TPC,使用图形样本和聚合网络(图形)来动态捕获土地覆盖类别之间非本地拓扑关系的表示。通过这种方式,可以通过组合非局部空间信息来进一步提高分类的鲁棒性。最后,提出了一种自适应加权融合(AWF)策略,以合并不同频段的推论,以便做出SIC和TPC的MF联合分类决策。比较实验表明,与某些最新方法相比,MF-STFNET可以取得更具竞争力的分类性能。
Compared with the rapid development of single-frequency multi-polarization SAR image classification technology, there is less research on the land cover classification of multifrequency polarimetric SAR (MF-PolSAR) images. In addition, the current deep learning methods for MF-PolSAR classification are mainly based on convolutional neural networks (CNNs), only local spatiality is considered but the nonlocal relationship is ignored. Therefore, based on semantic interaction and nonlocal topological structure, this paper proposes the MF semantics and topology fusion network (MF-STFnet) to improve MF-PolSAR classification performance. In MF-STFnet, two kinds of classification are implemented for each band, semantic information-based (SIC) and topological property-based (TPC). They work collaboratively during MF-STFnet training, which can not only fully leverage the complementarity of bands, but also combine local and nonlocal spatial information to improve the discrimination between different categories. For SIC, the designed crossband interactive feature extraction module (CIFEM) is embedded to explicitly model the deep semantic correlation among bands, thereby leveraging the complementarity of bands to make ground objects more separable. For TPC, the graph sample and aggregate network (GraphSAGE) is employed to dynamically capture the representation of nonlocal topological relations between land cover categories. In this way, the robustness of classification can be further improved by combining nonlocal spatial information. Finally, an adaptive weighting fusion (AWF) strategy is proposed to merge inference from different bands, so as to make the MF joint classification decisions of SIC and TPC. The comparative experiments show that MF-STFnet can achieve more competitive classification performance than some state-of-the-art methods.