论文标题
360度视频编码中的运动平面自适应相互预测
Motion-Plane-Adaptive Inter Prediction in 360-Degree Video Coding
论文作者
论文摘要
相互预测是实现现代视频编码标准高压效率的关键技术之一。在编码之前，需要将360度视频映射到2D图像平面，以便使用现有的视频编码标准进行压缩。然而，当将球形数据映射到2D图像平面上时不可避免地发生扭曲，但是，损害了经典的相互预测技术的性能。在本文中，我们为360度视频提出了一种运动平面自适应的相互预测技术（MPA），该视频考虑了360度视频的球形特征。基于视频的已知投影格式，MPA允许对3D空间中的不同运动平面进行相互预测，而不必在理论上任意映射 - 2D图像表示。我们此外，我们推导了运动平面自动运动矢量预测技术（MPA-MVP），该技术允许在不同的运动平面和运动模型之间转换运动信息。我们建议将MPA与MPA-MVP一起整合到最先进的H.266/VVC视频编码标准中，该标准显示了Bjontegaard Delta的明显节省1.72％，基于PSNR的峰值为3.97％，基于PSNR的峰值为3.97％，基于WS-PSNR的峰值为3.40％，基于WS-PSNR的峰值平均为3.40％。
Inter prediction is one of the key technologies enabling the high compression efficiency of modern video coding standards. 360-degree video needs to be mapped to the 2D image plane prior to coding in order to allow compression using existing video coding standards. The distortions that inevitably occur when mapping spherical data onto the 2D image plane, however, impair the performance of classical inter prediction techniques. In this paper, we propose a motion-plane-adaptive inter prediction technique (MPA) for 360-degree video that takes the spherical characteristics of 360-degree video into account. Based on the known projection format of the video, MPA allows to perform inter prediction on different motion planes in 3D space instead of having to work on the - in theory arbitrarily mapped - 2D image representation directly. We furthermore derive a motion-plane-adaptive motion vector prediction technique (MPA-MVP) that allows to translate motion information between different motion planes and motion models. Our proposed integration of MPA together with MPA-MVP into the state-of-the-art H.266/VVC video coding standard shows significant Bjontegaard Delta rate savings of 1.72% with a peak of 3.97% based on PSNR and 1.56% with a peak of 3.40% based on WS-PSNR compared to the VTM-14.2 baseline on average.
