论文标题
FVV Live:带消费电子硬件的实时免费观看视频系统
FVV Live: A real-time free-viewpoint video system with consumer electronics hardware
论文作者
论文摘要
FVV Live是一种新颖的端到端自由观看视频系统,设计为基于现成的组件的低成本和实时操作。该系统旨在使用消费级相机和硬件产生高质量的自由视频视频,从而使部署成本低下,并易于安装,以实现沉浸式事件播放或视频会议。 本文描述了系统的体系结构,包括在几个捕获服务器中的多视图加上深度数据的采集和编码以及边缘服务器上的虚拟视图综合。系统的所有块旨在克服硬件和网络施加的局限性,这直接影响了深度数据的准确性,从而影响了虚拟视图合成的质量。 FVV Live的设计允许任意数量的摄像机和捕获服务器,并且本文中提出的结果对应于具有9个基于立体声的深度摄像机的实现。 FVV Live呈现低运动和端到端的延迟,这使得无缝的自由视线导航和双边沉浸式通信。此外,已经通过主观评估和令人满意的结果评估了FVV Live的视觉质量,并且其他比较测试表明,它比最先进的DIBR替代方案所优选。
FVV Live is a novel end-to-end free-viewpoint video system, designed for low cost and real-time operation, based on off-the-shelf components. The system has been designed to yield high-quality free-viewpoint video using consumer-grade cameras and hardware, which enables low deployment costs and easy installation for immersive event-broadcasting or videoconferencing. The paper describes the architecture of the system, including acquisition and encoding of multiview plus depth data in several capture servers and virtual view synthesis on an edge server. All the blocks of the system have been designed to overcome the limitations imposed by hardware and network, which impact directly on the accuracy of depth data and thus on the quality of virtual view synthesis. The design of FVV Live allows for an arbitrary number of cameras and capture servers, and the results presented in this paper correspond to an implementation with nine stereo-based depth cameras. FVV Live presents low motion-to-photon and end-to-end delays, which enables seamless free-viewpoint navigation and bilateral immersive communications. Moreover, the visual quality of FVV Live has been assessed through subjective assessment with satisfactory results, and additional comparative tests show that it is preferred over state-of-the-art DIBR alternatives.