论文标题

激活新课程的可区分性,以进行几次分割

Activating the Discriminability of Novel Classes for Few-shot Segmentation

论文作者

Mei, Dianwen, Zhuo, Wei, Tian, Jiandong, Lu, Guangming, Pei, Wenjie

论文摘要

尽管现有方法在几乎没有射击的情况下取得了显着的成功,但仍有两个至关重要的挑战。首先,在基础课程的培训期间,新颖的课程的特征学习被抑制,因为新颖的课程总是被视为背景。因此,新颖班级的语义并不是很好。其次,大多数现有方法都无法考虑支持样本稀缺的支持偏差引起的支持与查询之间的潜在语义差距。为了避免这两个挑战,我们建议在特征编码阶段和分割的预测阶段明确激活新型类别的可区分性。在特征编码阶段,我们设计了传承语义的特征学习模块(SPFL)以首先利用,然后保留整个输入图像中包含的潜在语义,尤其是那些属于新颖类的背景。在细分的预测阶段,我们学习了一个自我精心设计的在线前景 - 背景分类器(SROFB),该分类器能够使用Query Image的高信心像素来改善自己,以促进其对查询图像的适应并桥接支持的语义语义差距。 Pascal-5 $^i $和Coco-20 $^i $数据集进行的广泛实验证明了这两种新颖设计的优势,既是定量和定性的。

Despite the remarkable success of existing methods for few-shot segmentation, there remain two crucial challenges. First, the feature learning for novel classes is suppressed during the training on base classes in that the novel classes are always treated as background. Thus, the semantics of novel classes are not well learned. Second, most of existing methods fail to consider the underlying semantic gap between the support and the query resulting from the representative bias by the scarce support samples. To circumvent these two challenges, we propose to activate the discriminability of novel classes explicitly in both the feature encoding stage and the prediction stage for segmentation. In the feature encoding stage, we design the Semantic-Preserving Feature Learning module (SPFL) to first exploit and then retain the latent semantics contained in the whole input image, especially those in the background that belong to novel classes. In the prediction stage for segmentation, we learn an Self-Refined Online Foreground-Background classifier (SROFB), which is able to refine itself using the high-confidence pixels of query image to facilitate its adaptation to the query image and bridge the support-query semantic gap. Extensive experiments on PASCAL-5$^i$ and COCO-20$^i$ datasets demonstrates the advantages of these two novel designs both quantitatively and qualitatively.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源