论文标题
共享潜在高斯混合模型的跨域医学图像翻译
Cross-Domain Medical Image Translation by Shared Latent Gaussian Mixture Model
论文作者
论文摘要
由于培训数据不足,当前基于深度学习的分割模型通常在域之间概括不多。在实际临床应用中,跨域图像分析工具的需求很高,因为通常需要来自不同领域的医学图像来实现精确的诊断。放射学的一个重要例子是从非对比度CT推广到对比度增强CT。对比度增强的CT扫描在不同阶段用于增强某些病理或器官。已显示许多现有的跨域图像到图像翻译模型可改善大型器官的跨域分割。但是,这样的模型缺乏在翻译过程中保留精细结构的能力,这对于许多临床应用非常重要,例如分割主动脉和骨盆动脉中的小钙化斑块。为了在医学图像翻译过程中保留精细的结构,我们使用高斯混合模型的共享潜在变量提出了一个基于贴片的模型。我们将图像翻译框架与跨域图像翻译的几种最新方法进行了比较,并表明我们的模型可以更好地保留精细的结构。通过执行翻译图像的两个任务来验证我们的模型的出色性能 - 主动脉斑块和胰腺分割的检测和分割。我们预计,由于生成的图像的质量提高并增强了保留小结构的能力,我们的框架实用性将扩展到除细分之外的其他问题。
Current deep learning based segmentation models often generalize poorly between domains due to insufficient training data. In real-world clinical applications, cross-domain image analysis tools are in high demand since medical images from different domains are often needed to achieve a precise diagnosis. An important example in radiology is generalizing from non-contrast CT to contrast enhanced CTs. Contrast enhanced CT scans at different phases are used to enhance certain pathologies or organs. Many existing cross-domain image-to-image translation models have been shown to improve cross-domain segmentation of large organs. However, such models lack the ability to preserve fine structures during the translation process, which is significant for many clinical applications, such as segmenting small calcified plaques in the aorta and pelvic arteries. In order to preserve fine structures during medical image translation, we propose a patch-based model using shared latent variables from a Gaussian mixture model. We compare our image translation framework to several state-of-the-art methods on cross-domain image translation and show our model does a better job preserving fine structures. The superior performance of our model is verified by performing two tasks with the translated images - detection and segmentation of aortic plaques and pancreas segmentation. We expect the utility of our framework will extend to other problems beyond segmentation due to the improved quality of the generated images and enhanced ability to preserve small structures.