论文标题

迈向基于草图的视觉理解的实用性

Towards Practicality of Sketch-Based Visual Understanding

论文作者

Bhunia, Ayan Kumar

论文摘要

草图已被用来概念化和描述史前时代的视觉对象。在过去的十年中,草图研究蓬勃发展,尤其是随着触摸屏设备的扩散。素描的大部分利用都是围绕以下事实,即它可以用来描绘视觉概念,无论年龄,种族,语言或人口统计学如何。草图的细粒互动性质有助于将草图应用于各种视觉理解任务,例如图像检索,图像生成或编辑,分割,3D形建模等。但是,基于个人感知,草图是高度抽象的和主观的。尽管大多数人都同意草图为用户提供细粒度的控制以描绘视觉对象,但许多人认为与其他查询/支持模式(如文本/标签)相比,由于其素描技巧有限,因此许多人认为素描乏味的过程。此外,收集细粒度的素描量关联是商业化草图应用程序的重要瓶颈。因此,本论文旨在将基于草图的视觉理解发展为更实用。

Sketches have been used to conceptualise and depict visual objects from pre-historic times. Sketch research has flourished in the past decade, particularly with the proliferation of touchscreen devices. Much of the utilisation of sketch has been anchored around the fact that it can be used to delineate visual concepts universally irrespective of age, race, language, or demography. The fine-grained interactive nature of sketches facilitates the application of sketches to various visual understanding tasks, like image retrieval, image-generation or editing, segmentation, 3D-shape modelling etc. However, sketches are highly abstract and subjective based on the perception of individuals. Although most agree that sketches provide fine-grained control to the user to depict a visual object, many consider sketching a tedious process due to their limited sketching skills compared to other query/support modalities like text/tags. Furthermore, collecting fine-grained sketch-photo association is a significant bottleneck to commercialising sketch applications. Therefore, this thesis aims to progress sketch-based visual understanding towards more practicality.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源