论文标题

基于质心损失的弱监督语义细分方法:应用质量控制和检查

A Weakly-Supervised Semantic Segmentation Approach based on the Centroid Loss: Application to Quality Control and Inspection

论文作者

Yao, Kai, Ortiz, Alberto, Bonnin-Pascual, Francisco

论文摘要

人们普遍认为,基于深度学习和卷积神经网络的当前视觉算法的关键部分之一是对足够数量的图像的注释来实现竞争性能。对于语义分割任务而言,这是特别困难的,因为必须在像素级别上生成注释。弱监督的语义细分旨在通过采用更简单的注释来降低这一成本,从而更容易,更便宜,更快地产生。在本文中,我们提出并评估了一种新的弱监督语义分割方法,利用了一种新型损失功能,其目标是抵消弱注释的影响。为此,此损失函数包括基于部分跨凝结损失的多个术语,是其中之一。该术语在所考虑的对象类中诱导图像像素的聚类,其目的是通过指导优化来改善分割网络的训练。该方法的性能是针对两个不同行业相关案例研究的数据集进行评估的:虽然一种涉及在质量控制应用程序的上下文中检测许多不同对象类的实例,但其他则源于视觉检查域,并涉及图像区域的定位,其像素与受特定类似缺陷影响的像素相对应。两种情况下报告的检测结果表明,尽管它们之间存在差异及其特定挑战,但使用弱注释并不能阻止两者达到竞争性能水平。

It is generally accepted that one of the critical parts of current vision algorithms based on deep learning and convolutional neural networks is the annotation of a sufficient number of images to achieve competitive performance. This is particularly difficult for semantic segmentation tasks since the annotation must be ideally generated at the pixel level. Weakly-supervised semantic segmentation aims at reducing this cost by employing simpler annotations that, hence, are easier, cheaper and quicker to produce. In this paper, we propose and assess a new weakly-supervised semantic segmentation approach making use of a novel loss function whose goal is to counteract the effects of weak annotations. To this end, this loss function comprises several terms based on partial cross-entropy losses, being one of them the Centroid Loss. This term induces a clustering of the image pixels in the object classes under consideration, whose aim is to improve the training of the segmentation network by guiding the optimization. The performance of the approach is evaluated against datasets from two different industry-related case studies: while one involves the detection of instances of a number of different object classes in the context of a quality control application, the other stems from the visual inspection domain and deals with the localization of images areas whose pixels correspond to scene surface points affected by a specific sort of defect. The detection results that are reported for both cases show that, despite the differences among them and the particular challenges, the use of weak annotations do not prevent from achieving a competitive performance level for both.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源