论文标题

通过提案对比学习进行有效的图像操纵检测

Towards Effective Image Manipulation Detection with Proposal Contrastive Learning

论文作者

Zeng, Yuyuan, Zhao, Bowen, Qiu, Shanzhao, Dai, Tao, Xia, Shu-Tao

论文摘要

深层模型已被广泛地用于图像操作检测中,该检测旨在对篡改图像进行分类并定位篡改区域。大多数现有方法主要集中于从篡改图像中提取全局特征,同时忽略了单个篡改图像中篡改和真实区域之间本地特征的关系。为了利用这种空间关系,我们提出了提出的对比度学习(PCL),以进行有效的图像操纵检测。我们的PCL通过分别从RGB和噪声视图中提取两种类型的全局特征来组成两流体系结构。为了进一步提高判别能力,我们通过代理提案对比学习任务来利用本地特征的关系,通过吸引/基于基于建议的正面/负面样本对来利用局部特征。此外,我们表明我们的PCL可以很容易地适应实践中未标记的数据,这可以降低手动标记成本并促进更具概括性的功能。几个标准数据集中的广泛实验表明,我们的PCL可以是获得一致改进的一般模块。该代码可在https://github.com/sandy-zeng/pcl上找到。

Deep models have been widely and successfully used in image manipulation detection, which aims to classify tampered images and localize tampered regions. Most existing methods mainly focus on extracting global features from tampered images, while neglecting the relationships of local features between tampered and authentic regions within a single tampered image. To exploit such spatial relationships, we propose Proposal Contrastive Learning (PCL) for effective image manipulation detection. Our PCL consists of a two-stream architecture by extracting two types of global features from RGB and noise views respectively. To further improve the discriminative power, we exploit the relationships of local features through a proxy proposal contrastive learning task by attracting/repelling proposal-based positive/negative sample pairs. Moreover, we show that our PCL can be easily adapted to unlabeled data in practice, which can reduce manual labeling costs and promote more generalizable features. Extensive experiments among several standard datasets demonstrate that our PCL can be a general module to obtain consistent improvement. The code is available at https://github.com/Sandy-Zeng/PCL.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源