论文标题
生成素:用于3D形状合成和分析的基于学习能量的模型
Generative VoxelNet: Learning Energy-Based Models for 3D Shape Synthesis and Analysis
论文作者
论文摘要
包含对象和场景的丰富几何信息的3D数据对于理解3D物理世界很有价值。随着大规模3D数据集的最新出现,拥有强大的3D生成模型以进行3D形状的合成和分析变得越来越重要。本文提出了一个深3D能量的模型,以代表体积形状。模型的最大似然训练遵循“通过合成”方案进行分析。提议的模型的好处是六倍:首先,与gan和vaes不同,模型训练不依赖任何辅助模型;其次,该模型可以通过Markov Chain Monte Carlo(MCMC)合成现实的3D形状。第三,条件模型可以应用于3D对象恢复和超级分辨率。第四,该模型可以用作高分辨率3D形状合成的多网格建模和采样框架中的构建块;第五,该模型可用于通过MCMC教学训练3D发电机;第六,经过训练的训练模型为3D数据提供了强大的功能提取器,这对于3D对象分类很有用。实验表明,所提出的模型可以生成高质量的3D形状模式,并且可用于各种3D形状分析。
3D data that contains rich geometry information of objects and scenes is valuable for understanding 3D physical world. With the recent emergence of large-scale 3D datasets, it becomes increasingly crucial to have a powerful 3D generative model for 3D shape synthesis and analysis. This paper proposes a deep 3D energy-based model to represent volumetric shapes. The maximum likelihood training of the model follows an "analysis by synthesis" scheme. The benefits of the proposed model are six-fold: first, unlike GANs and VAEs, the model training does not rely on any auxiliary models; second, the model can synthesize realistic 3D shapes by Markov chain Monte Carlo (MCMC); third, the conditional model can be applied to 3D object recovery and super resolution; fourth, the model can serve as a building block in a multi-grid modeling and sampling framework for high resolution 3D shape synthesis; fifth, the model can be used to train a 3D generator via MCMC teaching; sixth, the unsupervisedly trained model provides a powerful feature extractor for 3D data, which is useful for 3D object classification. Experiments demonstrate that the proposed model can generate high-quality 3D shape patterns and can be useful for a wide variety of 3D shape analysis.