论文标题

西蒙(Shimon

Shimon the Robot Film Composer and DeepScore: An LSTM for Generation of Film Scores based on Visual Analysis

论文作者

Savery, Richard, Weinberg, Gil

论文摘要

为电影作曲需要对电影的角色和电影的美学选择发展理解。我们建议将现有的视觉分析系统作为电影音乐的核心技术。我们提取电影功能,包括主要角色及其情感,以发展对电影叙事弧的计算机理解。该弧与视觉分析的主管审美选择(包括起搏和运动水平)结合使用。提出了两个系统,第一次使用机器人膜作曲家和Marimbist在实时性能中产生胶片分数。第二个基于软件的系统建立在机器人膜作曲家的结果基础上,以创建叙事驱动的电影分数。

Composing for a film requires developing an understanding of the film, its characters and the film aesthetic choices made by the director. We propose using existing visual analysis systems as a core technology for film music generation. We extract film features including main characters and their emotions to develop a computer understanding of the film's narrative arc. This arc is combined with visually analyzed director aesthetic choices including pacing and levels of movement. Two systems are presented, the first using a robotic film composer and marimbist to generate film scores in real-time performance. The second software-based system builds on the results from the robot film composer to create narrative driven film scores.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源