论文标题
撰写和点缀:结构良好的钢琴性能通过两阶段的方法
Compose & Embellish: Well-Structured Piano Performance Generation via A Two-Stage Approach
论文作者
论文摘要
即使具有诸如变形金刚之类的强序模型,也可以通过远程音乐结构产生表现力的钢琴表演仍然具有挑战性。同时,构成结构良好的旋律或铅片(旋律 +和弦)的方法,即更简单的音乐形式,获得了更大的成功。在观察上述内容时,我们设计了一个基于两阶段变压器的框架,该框架首先构成铅片,然后用伴奏和表达触摸来修饰它。这种分解还可以预处理非钢琴数据。我们的客观和主观实验表明,构成和装饰会缩小当前最新状态和真实表演之间的结构性差异,并提高了其他音乐方面,例如丰富性和连贯性。
Even with strong sequence models like Transformers, generating expressive piano performances with long-range musical structures remains challenging. Meanwhile, methods to compose well-structured melodies or lead sheets (melody + chords), i.e., simpler forms of music, gained more success. Observing the above, we devise a two-stage Transformer-based framework that Composes a lead sheet first, and then Embellishes it with accompaniment and expressive touches. Such a factorization also enables pretraining on non-piano data. Our objective and subjective experiments show that Compose & Embellish shrinks the gap in structureness between a current state of the art and real performances by half, and improves other musical aspects such as richness and coherence as well.