论文标题
音乐封面图像的条件矢量图形生成
Conditional Vector Graphics Generation for Music Cover Images
论文作者
论文摘要
生成对抗网络(GAN)激发了计算机图像合成域的快速增长。由于几乎所有现有的图像合成算法都将图像视为像素矩阵,因此高分辨率图像合成是复杂的。良好的替代方法可以是向量图像。但是,它们属于高度复杂的参数空间,这是解决GAN合成向量图形的任务的限制。在本文中,我们考虑了一个特定的应用领域,该域极大地软化了该限制,从而允许使用向量图像合成。 音乐覆盖图像应满足Internet流服务和打印标准的要求,这意味着图形材料的高分辨率很高,而对此类图像的内容没有任何其他要求。现有的音乐封面图像生成服务不会自行分析曲目;但是,某些服务主要仅考虑流派标签。为了作为反映音乐并由简单几何对象组成的矢量图像产生覆盖,我们建议一种基于GAN的算法称为Covergan。与Attngan和Dall-E根据标题或歌词相比,对结果图像的评估是基于它们与音乐的对应。此外,已经根据生成的封面图像对音乐曲目的对应关系进行了评估,从而评估了Covergan发现的模式的重要性。听众评估拟议算法产生的音乐封面非常令人满意,并且对应于曲目。音乐封面图像生成代码和演示可从https://github.com/izhanvarsky/covergan获得。
Generative Adversarial Networks (GAN) have motivated a rapid growth of the domain of computer image synthesis. As almost all the existing image synthesis algorithms consider an image as a pixel matrix, the high-resolution image synthesis is complicated.A good alternative can be vector images. However, they belong to the highly sophisticated parametric space, which is a restriction for solving the task of synthesizing vector graphics by GANs. In this paper, we consider a specific application domain that softens this restriction dramatically allowing the usage of vector image synthesis. Music cover images should meet the requirements of Internet streaming services and printing standards, which imply high resolution of graphic materials without any additional requirements on the content of such images. Existing music cover image generation services do not analyze tracks themselves; however, some services mostly consider only genre tags. To generate music covers as vector images that reflect the music and consist of simple geometric objects, we suggest a GAN-based algorithm called CoverGAN. The assessment of resulting images is based on their correspondence to the music compared with AttnGAN and DALL-E text-to-image generation according to title or lyrics. Moreover, the significance of the patterns found by CoverGAN has been evaluated in terms of the correspondence of the generated cover images to the musical tracks. Listeners evaluate the music covers generated by the proposed algorithm as quite satisfactory and corresponding to the tracks. Music cover images generation code and demo are available at https://github.com/IzhanVarsky/CoverGAN.