论文标题

自我监督的代表性学习,以检测膝盖MR视频中ACL泪受伤

Self-Supervised Representation Learning for Detection of ACL Tear Injury in Knee MR Videos

论文作者

Manna, Siladittya, Bhattacharya, Saumik, Pal, Umapada

论文摘要

基于深度学习的模型用于计算机视觉应用的成功需要大规模的人注释数据,这些数据通常很昂贵。自我监督的学习是无监督学习的子集,通过从未标记的图像或视频数据中学习有意义的功能来解决此问题。在本文中,我们提出了一种自我监督的学习方法,通过执行模型学习解剖特征,从MR视频剪辑中学习可转移的功能。借口任务模型旨在预测将MR视频框架分为MR的杂耍图像补丁的正确排序。据我们所知,从MR视频中执行伤害分类任务的监督学习模型都没有提供任何模型决定的解释,因此使我们的工作成为MR视频数据的第一项。借口任务的实验表明,这种提出的方​​法使模型能够学习空间上下文不变特征,从而有助于在下游任务中可靠且可解释的性能,例如膝盖MRI的前交叉韧带撕裂损伤的分类。本文提出的新型卷积神经网络的效率反映在下游任务中获得的实验结果。

The success of deep learning based models for computer vision applications requires large scale human annotated data which are often expensive to generate. Self-supervised learning, a subset of unsupervised learning, handles this problem by learning meaningful features from unlabeled image or video data. In this paper, we propose a self-supervised learning approach to learn transferable features from MR video clips by enforcing the model to learn anatomical features. The pretext task models are designed to predict the correct ordering of the jumbled image patches that the MR video frames are divided into. To the best of our knowledge, none of the supervised learning models performing injury classification task from MR video provide any explanation for the decisions made by the models and hence makes our work the first of its kind on MR video data. Experiments on the pretext task show that this proposed approach enables the model to learn spatial context invariant features which help for reliable and explainable performance in downstream tasks like classification of Anterior Cruciate Ligament tear injury from knee MRI. The efficiency of the novel Convolutional Neural Network proposed in this paper is reflected in the experimental results obtained in the downstream task.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源