论文标题
使用注意引导样式转移网络净化真实图像,以进行凝视估算
Purifying Real Images with an Attention-guided Style Transfer Network for Gaze Estimation
论文作者
论文摘要
最近,通过合成的学习进展提出了一种培训模型,以有效地降低人类和物质资源的成本。但是,由于合成图像的分布与真实图像相比不同,因此无法实现所需的性能。真实图像由多种形式的光取向组成,而合成图像由均匀的光取向组成。这些特征分别被认为是室外场景的特征。为了解决这个问题,先前的方法学到了一个模型来改善合成图像的现实主义。与以前的方法不同,本文试图通过提取判别性和可靠的特征来将室外真实图像转换为室内合成图像来净化真实图像。在本文中,我们首先介绍分割面具以构建RGB面罩对作为输入,然后我们设计了一个注意引导样式转移网络,以从注意力和BKGD(背景)区域分别学习样式功能,从充分和注意区域学习内容功能。此外,我们提出了一种新颖的区域级任务指导损失,以限制从样式和内容中学到的特征。使用混合研究(定性和定量)方法进行实验,以证明在复杂方向上纯化真实图像的可能性。我们在包括LPW,可可和Mpiigaze在内的三个公共数据集上评估了所提出的方法。广泛的实验结果表明,所提出的方法是有效的,并实现了最先进的结果。
Recently, the progress of learning-by-synthesis has proposed a training model for synthetic images, which can effectively reduce the cost of human and material resources. However, due to the different distribution of synthetic images compared to real images, the desired performance cannot be achieved. Real images consist of multiple forms of light orientation, while synthetic images consist of a uniform light orientation. These features are considered to be characteristic of outdoor and indoor scenes, respectively. To solve this problem, the previous method learned a model to improve the realism of the synthetic image. Different from the previous methods, this paper try to purify real image by extracting discriminative and robust features to convert outdoor real images to indoor synthetic images. In this paper, we first introduce the segmentation masks to construct RGB-mask pairs as inputs, then we design a attention-guided style transfer network to learn style features separately from the attention and bkgd(background) region , learn content features from full and attention region. Moreover, we propose a novel region-level task-guided loss to restrain the features learnt from style and content. Experiments were performed using mixed studies (qualitative and quantitative) methods to demonstrate the possibility of purifying real images in complex directions. We evaluate the proposed method on three public datasets, including LPW, COCO and MPIIGaze. Extensive experimental results show that the proposed method is effective and achieves the state-of-the-art results.