论文标题

Movi:大型多功能运动和视频数据集

MoVi: A Large Multipurpose Motion and Video Dataset

论文作者

Ghorbani, Saeed, Mahdaviani, Kimia, Thaler, Anne, Kording, Konrad, Cook, Douglas James, Blohm, Gunnar, Troje, Nikolaus F.

论文摘要

人类运动既是强烈研究的领域,也是许多应用程序(例如角色动画)的基础。对于许多应用程序,从视频中识别运动或分析运动数据集至关重要。在这里,我们介绍了一个新的人类运动和视频数据集Movi,我们可以公开使用。它包含60名女演员和30名男演员,他们进行了20种预定义的日常动作和运动运动,以及一个自选运动。在五回合中,使用不同的硬件系统(包括光学运动捕获系统,摄像机和惯性测量单元(IMU))记录了相同的参与者和运动。对于某些捕获弹,穿着天然服装时记录了演员,因为他们穿着最小的衣服。总体而言,我们的数据集包含9个小时的运动捕获数据,从4个不同的角度(包括一个手持相机)的17小时视频数据和6.6小时的IMU数据。在本文中,我们描述了如何收集和后处理数据集;我们提出了与骨骼运动相关的骨骼运动和全身形状变形的最新估计。我们讨论了潜在研究的示例,该数据集可以启用。

Human movements are both an area of intense study and the basis of many applications such as character animation. For many applications, it is crucial to identify movements from videos or analyze datasets of movements. Here we introduce a new human Motion and Video dataset MoVi, which we make available publicly. It contains 60 female and 30 male actors performing a collection of 20 predefined everyday actions and sports movements, and one self-chosen movement. In five capture rounds, the same actors and movements were recorded using different hardware systems, including an optical motion capture system, video cameras, and inertial measurement units (IMU). For some of the capture rounds, the actors were recorded when wearing natural clothing, for the other rounds they wore minimal clothing. In total, our dataset contains 9 hours of motion capture data, 17 hours of video data from 4 different points of view (including one hand-held camera), and 6.6 hours of IMU data. In this paper, we describe how the dataset was collected and post-processed; We present state-of-the-art estimates of skeletal motions and full-body shape deformations associated with skeletal motion. We discuss examples for potential studies this dataset could enable.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源