论文标题
TBC-NET:用于使用语义约束的红外小目标检测的实时检测器
TBC-Net: A real-time detector for infrared small target detection using semantic constraint
论文作者
论文摘要
红外小目标检测是红外搜索和跟踪(IRST)系统中的关键技术。尽管最近在可见光图像的视觉任务中广泛使用了深度学习,但由于难以学习小目标特征,因此很少在红外小目标检测中使用它。在本文中,我们提出了一种新型的轻型卷积神经网络TBC-NET,用于红外小目标检测。 TBCNET由目标提取模块(TEM)和语义约束模块(SCM)组成,该模块用于从红外图像中提取小目标,并分别在训练过程中分别对提取的目标图像进行分类。同时,我们提出了联合损失函数和一种训练方法。 SCM通过组合高级分类任务并解决了学习由阶级不平衡问题引起的特征的难以学习的问题,从而对TEM施加了语义限制。在训练过程中,从输入图像中提取目标,然后通过SCM分类。在推断期间,仅使用TEM检测小目标。我们还提出了一种数据综合方法来生成培训数据。实验结果表明,与传统方法相比,TBC-NET可以更好地减少由复杂背景引起的错误警报,所提出的网络结构和关节损失对小型目标特征学习具有显着改善。此外,TBC-NET可以在NVIDIA JETSON AGX XAVIER开发委员会上实现实时检测,该委员会适合使用配备红外传感器的无人机进行现场研究。
Infrared small target detection is a key technique in infrared search and tracking (IRST) systems. Although deep learning has been widely used in the vision tasks of visible light images recently, it is rarely used in infrared small target detection due to the difficulty in learning small target features. In this paper, we propose a novel lightweight convolutional neural network TBC-Net for infrared small target detection. The TBCNet consists of a target extraction module (TEM) and a semantic constraint module (SCM), which are used to extract small targets from infrared images and to classify the extracted target images during the training, respectively. Meanwhile, we propose a joint loss function and a training method. The SCM imposes a semantic constraint on TEM by combining the high-level classification task and solve the problem of the difficulty to learn features caused by class imbalance problem. During the training, the targets are extracted from the input image and then be classified by SCM. During the inference, only the TEM is used to detect the small targets. We also propose a data synthesis method to generate training data. The experimental results show that compared with the traditional methods, TBC-Net can better reduce the false alarm caused by complicated background, the proposed network structure and joint loss have a significant improvement on small target feature learning. Besides, TBC-Net can achieve real-time detection on the NVIDIA Jetson AGX Xavier development board, which is suitable for applications such as field research with drones equipped with infrared sensors.