论文标题

基于深度学习的视频超级分辨率:一项全面调查

Video Super Resolution Based on Deep Learning: A Comprehensive Survey

论文作者

Liu, Hongying, Ruan, Zhubo, Zhao, Peng, Dong, Chao, Shang, Fanhua, Liu, Yuanyuan, Yang, Linlin, Timofte, Radu

论文摘要

近年来,深度学习在许多领域取得了长足的进步,例如图像识别,自然语言处理,语音识别和视频超分辨率。在这项调查中,我们全面研究了基于深度学习的33个最先进的视频超分辨率(VSR)方法。众所周知,视频帧中信息的杠杆作用对于视频超分辨率很重要。因此,我们建议分类法并根据利用框架间信息的方式将方法分类为六个子类别。此外,详细描述了所有方法的架构和实现细节。最后,我们总结并比较了某些基准数据集上代表性VSR方法的性能。我们还讨论了一些挑战,VSR社区的研究人员需要进一步解决这些挑战。据我们所知,这项工作是对VSR任务的首次系统评价,预计将为该领域的最新研究做出贡献,并有可能加深我们基于深度学习的VSR技术的理解。

In recent years, deep learning has made great progress in many fields such as image recognition, natural language processing, speech recognition and video super-resolution. In this survey, we comprehensively investigate 33 state-of-the-art video super-resolution (VSR) methods based on deep learning. It is well known that the leverage of information within video frames is important for video super-resolution. Thus we propose a taxonomy and classify the methods into six sub-categories according to the ways of utilizing inter-frame information. Moreover, the architectures and implementation details of all the methods are depicted in detail. Finally, we summarize and compare the performance of the representative VSR method on some benchmark datasets. We also discuss some challenges, which need to be further addressed by researchers in the community of VSR. To the best of our knowledge, this work is the first systematic review on VSR tasks, and it is expected to make a contribution to the development of recent studies in this area and potentially deepen our understanding to the VSR techniques based on deep learning.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源