论文标题
超声视频摘要使用深度加固学习
Ultrasound Video Summarization using Deep Reinforcement Learning
论文作者
论文摘要
视频是诊断的必要成像方式,例如在超声成像中进行内窥镜检查或运动评估。但是,在医学图像分析社区中,视频并未受到很多关注。在临床实践中,由于视频数据需要很长时间来处理,注释或审核,因此有效地利用原始诊断视频数据是一个挑战。在本文中,我们介绍了一种针对医疗视频数据需求量身定制的小说,全自动的视频摘要方法。我们的方法被框起来是强化学习问题,并产生专注于保存重要诊断信息的代理。我们对胎儿超声筛查的视频进行了评估,其中通常只有少量记录的数据被诊断。我们表明我们的方法优于替代视频摘要方法,并且保留了临床诊断标准所需的基本信息。
Video is an essential imaging modality for diagnostics, e.g. in ultrasound imaging, for endoscopy, or movement assessment. However, video hasn't received a lot of attention in the medical image analysis community. In the clinical practice, it is challenging to utilise raw diagnostic video data efficiently as video data takes a long time to process, annotate or audit. In this paper we introduce a novel, fully automatic video summarization method that is tailored to the needs of medical video data. Our approach is framed as reinforcement learning problem and produces agents focusing on the preservation of important diagnostic information. We evaluate our method on videos from fetal ultrasound screening, where commonly only a small amount of the recorded data is used diagnostically. We show that our method is superior to alternative video summarization methods and that it preserves essential information required by clinical diagnostic standards.