论文标题
西蒙(Shimon
Shimon the Robot Film Composer and DeepScore: An LSTM for Generation of Film Scores based on Visual Analysis
论文作者
论文摘要
为电影作曲需要对电影的角色和电影的美学选择发展理解。我们建议将现有的视觉分析系统作为电影音乐的核心技术。我们提取电影功能,包括主要角色及其情感,以发展对电影叙事弧的计算机理解。该弧与视觉分析的主管审美选择(包括起搏和运动水平)结合使用。提出了两个系统,第一次使用机器人膜作曲家和Marimbist在实时性能中产生胶片分数。第二个基于软件的系统建立在机器人膜作曲家的结果基础上,以创建叙事驱动的电影分数。
Composing for a film requires developing an understanding of the film, its characters and the film aesthetic choices made by the director. We propose using existing visual analysis systems as a core technology for film music generation. We extract film features including main characters and their emotions to develop a computer understanding of the film's narrative arc. This arc is combined with visually analyzed director aesthetic choices including pacing and levels of movement. Two systems are presented, the first using a robotic film composer and marimbist to generate film scores in real-time performance. The second software-based system builds on the results from the robot film composer to create narrative driven film scores.