论文标题

Swinchex:带有变压器的胸部X射线图像上的多标签分类

SwinCheX: Multi-label classification on chest X-ray images with transformers

论文作者

Taslimi, Sina, Taslimi, Soroush, Fathi, Nima, Salehi, Mohammadreza, Rohban, Mohammad Hossein

论文摘要

根据诊断各种疾病的胸部X射线图像的可观增长,以及收集大量数据集,使用深层神经网络进行自动诊断程序已占据了专家的思想。计算机视觉中的大多数可用方法都使用CNN主链来获得分类问题的高精度。然而,最近的研究表明,在NLP中被确定为事实上方法的变压器也可以优于许多基于CNN的模型。本文提出了一个基于Swin Transformer的多标签分类深层模型,作为实现最新诊断分类的骨干。它利用多层感知器(也称为MLP)用于头部体系结构。我们对最广泛,最大的X射线数据集之一评估了模型,称为“ Chest X-Ray14”,该数据集由30,000多名14例著名胸部疾病的患者中的100,000多个额叶/背景图像组成。我们的模型已经用几个数量的MLP层用于头部设置,每个层都在所有类别上都取得了竞争性的AUC分数。对胸部X射线14的全面实验表明,与以前的SOTA平均AUC为0.799相比,三层头的平均AUC得分为0.810,其平均AUC得分为0.810。我们建议对现有方法进行公平基准测试的实验设置,该设置可以用作未来研究的基础。最后,我们通过确认所提出的方法参与了胸部的病理相关区域,从而跟进了结果。

According to the considerable growth in the avail of chest X-ray images in diagnosing various diseases, as well as gathering extensive datasets, having an automated diagnosis procedure using deep neural networks has occupied the minds of experts. Most of the available methods in computer vision use a CNN backbone to acquire high accuracy on the classification problems. Nevertheless, recent researches show that transformers, established as the de facto method in NLP, can also outperform many CNN-based models in vision. This paper proposes a multi-label classification deep model based on the Swin Transformer as the backbone to achieve state-of-the-art diagnosis classification. It leverages Multi-Layer Perceptron, also known as MLP, for the head architecture. We evaluate our model on one of the most widely-used and largest x-ray datasets called "Chest X-ray14," which comprises more than 100,000 frontal/back-view images from over 30,000 patients with 14 famous chest diseases. Our model has been tested with several number of MLP layers for the head setting, each achieves a competitive AUC score on all classes. Comprehensive experiments on Chest X-ray14 have shown that a 3-layer head attains state-of-the-art performance with an average AUC score of 0.810, compared to the former SOTA average AUC of 0.799. We propose an experimental setup for the fair benchmarking of existing methods, which could be used as a basis for the future studies. Finally, we followed up our results by confirming that the proposed method attends to the pathologically relevant areas of the chest.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源