论文标题
带笼子的变形辐射场
Deforming Radiance Fields with Cages
论文作者
论文摘要
辐射场的最新进展可以使静态或动态3D场景的感性渲染，但仍然不支持用于场景操纵或动画的明确变形。在本文中，我们提出了一种可以实现辐射场的新类型变形的方法：自由形式的辐射场磁场变形。我们使用三角形网格，将称为笼子作为接口的前景对象封闭了前景对象，并且通过操纵笼顶点，我们的方法可以使辐射场的自由形式变形。我们方法的核心是基于笼子的变形，通常用于网格变形。我们提出了一种新颖的公式，将其扩展到辐射场，该公式将采样点的位置和视图方向映射到从变形空间到规范空间，从而实现了变形场景的渲染。合成数据集和现实世界数据集的变形结果证明了我们方法的有效性。
Recent advances in radiance fields enable photorealistic rendering of static or dynamic 3D scenes, but still do not support explicit deformation that is used for scene manipulation or animation. In this paper, we propose a method that enables a new type of deformation of the radiance field: free-form radiance field deformation. We use a triangular mesh that encloses the foreground object called cage as an interface, and by manipulating the cage vertices, our approach enables the free-form deformation of the radiance field. The core of our approach is cage-based deformation which is commonly used in mesh deformation. We propose a novel formulation to extend it to the radiance field, which maps the position and the view direction of the sampling points from the deformed space to the canonical space, thus enabling the rendering of the deformed scene. The deformation results of the synthetic datasets and the real-world datasets demonstrate the effectiveness of our approach.
