论文标题
在第二次谐波生成显微镜和深度学习的角膜水肿的自动检测上
On the Automated Detection of Corneal Edema with Second Harmonic Generation Microscopy and Deep Learning
论文作者
论文摘要
当角膜在其生理水平上方水中水合时,它开始显着散射光,失去透明度,从而损害视力。这种称为角膜水肿的疾病可能与不同的原因有关,例如角膜疤痕,角膜感染,角膜炎症等,使其难以诊断和量化。先前的作品表明,第二次谐波显微镜(SHG)代表了一种有价值的非线性光学成像工具,可非侵入性地识别和监测角膜胶原结构中的变化,并可能在未来的体内角膜诊断方法中起关键作用。但是,鉴于公共数据集的可用性低和培训资源,将SHG数据的解释在将这种方法转移到临床环境中时可能会带来重大问题。在这项工作中,我们探讨了三种深度学习模型的使用,即非常受欢迎的InceptionV3和Resnet50,以及Flimba(一种自定义的开发体系结构,不需要预训练),以自动检测猪角膜SHG图像中的角膜水肿。我们讨论并评估了调整后的数据扩展策略,并观察到基于不同体系结构的深度学习模型提供了互补的结果。重要的是,我们观察到,这种互补模型的联合使用在区分水肿和健康的角膜组织的情况下提高了总体分类性能,直至AU-ROC = 0.98。这些结果可能有可能推断到其他诊断情况,例如在不同阶段的角膜水肿的区分,角膜的水合水平的自动提取或对角膜水肿原因的自动鉴定,因此为角膜诊断的新方法铺平了铺平的方法,并具有深层的诊断辅助辅助的非线性光学成像。
When the cornea becomes hydrated above its physiologic level it begins to significantly scatter light, loosing transparency and thus impairing eyesight. This condition, known as corneal edema, can be associated with different causes, such as corneal scarring, corneal infection, corneal inflammation, and others, making it difficult to diagnose and quantify. Previous works have shown that Second Harmonic Generation Microscopy (SHG) represents a valuable non-linear optical imaging tool to non-invasively identify and monitor changes in the collagen architecture of the cornea, potentially playing a pivotal role in future in-vivo cornea diagnostic methods. However, the interpretation of SHG data can pose significant problems when transferring such approaches to clinical settings, given the low availability of public data sets, and training resources. In this work we explore the use of three Deep Learning models, the highly popular InceptionV3 and ResNet50, alongside FLIMBA, a custom developed architecture, requiring no pre-training, to automatically detect corneal edema in SHG images of porcine cornea. We discuss and evaluate data augmentation strategies tuned to the specifics of the herein addressed application and observe that Deep Learning models building on different architectures provide complementary results. Importantly, we observe that the combined use of such complementary models boosts the overall classification performance in the case of differentiating edematous and healthy corneal tissues, up to an AU-ROC=0.98. These results have potential to be extrapolated to other diagnostics scenarios, such as differentiation of corneal edema in different stages, automated extraction of hydration level of cornea, or automated identification of corneal edema causes, and thus pave the way for novel methods for cornea diagnostics with Deep-Learning assisted non-linear optical imaging.