论文标题
Sophiapop:《人类流行音乐合作的实验》
SophiaPop: Experiments in Human-AI Collaboration on Popular Music
论文作者
论文摘要
由各种神经网络,机器人技术和艺术工具组成的多样化的工程师,艺术家和算法团队合作为Sophiapop创作歌曲,并使对机器人的索菲亚(Sophia the Sophia the Robot)的成绩为机器人的名人和动画角色而动画。索菲亚(Sophia)是艺术,研究和其他用途的平台。为了推进索菲亚的艺术和技术,我们将各种AI与她作为Popstar的新兴事业相结合。她实际的AI生成的流行歌词,音乐和绘画以及动画对话,她在讨论她的经历的叙述中与人类的实时互动。为了创作音乐,Sophiapop团队从人类和AI生成的Sophia角色个性内容以及流行音乐歌曲形式,训练并为许多AI算法提供种子,包括专家模型,以及经定制培训的变形金刚神经网络,然后生成原始流行歌词和旋律,从而为许多AI算法提供训练并提供种子。我们的音乐家包括弗兰基·斯托姆(Frankie Storm),亚当·皮克雷尔(Adam Pickrell)和老虎·达罗(Tiger Darrow),然后对AI生成的音乐内容进行了解释,包括唱歌和乐器。然后,由基于神经网络的索菲亚语音处理了人类表现的唱歌数据,该声音是由CereProc对人类表演进行定制的。然后,这个AI产生了独特的Sophia声音歌曲。然后,我们使用各种动画生成器和人类生成的动画动画索菲亚(Sophia)在音乐视频中唱歌。作为算法和人类,Sophiapop共同努力,代表了人类的合作,对人类AI共生有抱负。我们认为,多个学科与人类和人工智学的这种创造性融合可以使AI以新的和令人兴奋的方式与人类文化相关,并带来对人类关系未来的有希望的愿景。
A diverse team of engineers, artists, and algorithms, collaborated to create songs for SophiaPop, via various neural networks, robotics technologies, and artistic tools, and animated the results on Sophia the Robot, a robotic celebrity and animated character. Sophia is a platform for arts, research, and other uses. To advance the art and technology of Sophia, we combine various AI with a fictional narrative of her burgeoning career as a popstar. Her actual AI-generated pop lyrics, music, and paintings, and animated conversations wherein she interacts with humans real-time in narratives that discuss her experiences. To compose the music, SophiaPop team built corpora from human and AI-generated Sophia character personality content, along with pop music song forms, to train and provide seeds for a number of AI algorithms including expert models, and custom-trained transformer neural networks, which then generated original pop-song lyrics and melodies. Our musicians including Frankie Storm, Adam Pickrell, and Tiger Darrow, then performed interpretations of the AI-generated musical content, including singing and instrumentation. The human-performed singing data then was processed by a neural-network-based Sophia voice, which was custom-trained from human performances by Cereproc. This AI then generated the unique Sophia voice singing of the songs. Then we animated Sophia to sing the songs in music videos, using a variety of animation generators and human-generated animations. Being algorithms and humans, working together, SophiaPop represents a human-AI collaboration, aspiring toward human AI symbiosis. We believe that such a creative convergence of multiple disciplines with humans and AI working together, can make AI relevant to human culture in new and exciting ways, and lead to a hopeful vision for the future of human-AI relations.