论文标题
Flare7k:现象学夜间耀斑去除数据集
Flare7K: A Phenomenological Nighttime Flare Removal Dataset
论文作者
论文摘要
人造灯通常会在晚上捕获的图像上留下强烈的镜头耀斑伪像。夜间耀斑不仅会影响视觉质量,而且会降低视觉算法的性能。现有的耀斑去除方法主要集中于去除白天耀斑,并在夜间失败。由于夜间灯光和人造灯的独特亮度和范围,以及夜间捕获的耀斑的各种图案和图像降解,因此夜间耀斑清除是具有挑战性的。夜间耀斑清除数据集的稀缺性限制了这项关键任务的研究。在本文中,我们介绍了第一个夜间移除数据集Flare7k,该数据集是根据现实世界中夜间镜头耀斑的观察和统计数据生成的。它提供5,000个散射和2,000张反射耀斑图像,包括25种散射耀斑和10种反射耀斑的散射图像。可以随机添加7,000个耀斑图案,形成耀斑腐败和无耀斑的图像对。借助配对数据,我们可以训练深层模型以有效地恢复现实世界中拍摄的耀斑腐败图像。除了丰富的耀斑模式外,我们还提供了丰富的注释,包括光源的标签,闪闪发光的眩光,反射式耀斑和条纹,通常在现有数据集中不存在。因此,我们的数据集可以促进夜间耀斑的新作品,并对耀斑模式进行更细粒度的分析。广泛的实验表明,我们的数据集为现有的耀斑数据集增加了多样性,并推动了夜间耀斑去除的边界。
Artificial lights commonly leave strong lens flare artifacts on images captured at night. Nighttime flare not only affects the visual quality but also degrades the performance of vision algorithms. Existing flare removal methods mainly focus on removing daytime flares and fail in nighttime. Nighttime flare removal is challenging because of the unique luminance and spectrum of artificial lights and the diverse patterns and image degradation of the flares captured at night. The scarcity of nighttime flare removal datasets limits the research on this crucial task. In this paper, we introduce, Flare7K, the first nighttime flare removal dataset, which is generated based on the observation and statistics of real-world nighttime lens flares. It offers 5,000 scattering and 2,000 reflective flare images, consisting of 25 types of scattering flares and 10 types of reflective flares. The 7,000 flare patterns can be randomly added to flare-free images, forming the flare-corrupted and flare-free image pairs. With the paired data, we can train deep models to restore flare-corrupted images taken in the real world effectively. Apart from abundant flare patterns, we also provide rich annotations, including the labeling of light source, glare with shimmer, reflective flare, and streak, which are commonly absent from existing datasets. Hence, our dataset can facilitate new work in nighttime flare removal and more fine-grained analysis of flare patterns. Extensive experiments show that our dataset adds diversity to existing flare datasets and pushes the frontier of nighttime flare removal.