论文标题
Gan生成的面部图像的广义视觉质量评估
Generalized Visual Quality Assessment of GAN-Generated Face Images
论文作者
论文摘要
近年来,通过产生的对抗网络(GAN),人们对面部产生的兴趣极大地增加了。已经开发了许多成功的GAN算法,以在不同的应用方案中产生生动的面部图像。但是,几乎没有专门用于对这种GAN生成的面部图像(GFI)的自动质量评估,甚至更少专门用于对未见GAN模型产生的GFI的广义且稳健的质量评估。在此,我们首次尝试研究了GFI的广义质量评估的主观和客观质量。更具体地说,我们建立了一个大规模数据库,该数据库由四种GAN算法的GFI组成,来自图像质量评估(IQA)测度的伪标签以及通过主观测试的人类意见分数。随后,我们开发了一个质量评估模型,该模型能够基于元学习的可用GAN算法和看不见的GAN算法为GFI提供准确的质量预测。特别是,要从具有有限的GAN算法的GFIS对学习共享的知识,我们将发展卷积阻滞关注(CBA)和基于面部属性的分析(ABA)模块,以确保学习的知识往往与人类的视觉感知一致。广泛的实验表明,与最先进的IQA模型相比,所提出的模型在评估看不见的GAN算法时能够保持有效性更好,并且能够保持有效性。
Recent years have witnessed the dramatically increased interest in face generation with generative adversarial networks (GANs). A number of successful GAN algorithms have been developed to produce vivid face images towards different application scenarios. However, little work has been dedicated to automatic quality assessment of such GAN-generated face images (GFIs), even less have been devoted to generalized and robust quality assessment of GFIs generated with unseen GAN model. Herein, we make the first attempt to study the subjective and objective quality towards generalized quality assessment of GFIs. More specifically, we establish a large-scale database consisting of GFIs from four GAN algorithms, the pseudo labels from image quality assessment (IQA) measures, as well as the human opinion scores via subjective testing. Subsequently, we develop a quality assessment model that is able to deliver accurate quality predictions for GFIs from both available and unseen GAN algorithms based on meta-learning. In particular, to learn shared knowledge from GFIs pairs that are born of limited GAN algorithms, we develop the convolutional block attention (CBA) and facial attributes-based analysis (ABA) modules, ensuring that the learned knowledge tends to be consistent with human visual perception. Extensive experiments exhibit that the proposed model achieves better performance compared with the state-of-the-art IQA models, and is capable of retaining the effectiveness when evaluating GFIs from the unseen GAN algorithms.