论文标题
基于图形神经网络的儿童活动识别
Graph Neural Network based Child Activity Recognition
论文作者
论文摘要
本文提出了基于图形卷积网络(GCN)深度学习模型的儿童活动识别(CAR)的实现,因为尽管GCN表现出色,但尽管该领域的先前实现已由CNN,LSTM和其他方法主导。据我们所知,我们是第一个在儿童活动识别领域中使用GCN模型的人。在克服尺寸较小的公开儿童动作数据集的挑战时,实施了几种学习方法,例如功能提取,微调和课程学习,以提高模型性能。受到有关在汽车中转移学习的使用矛盾的主张的启发,我们对转移学习进行了详细的实施和分析,以及对汽车的负转移学习效果的研究,因为它以前尚未解决。作为主要贡献,我们能够开发基于ST-GCN的汽车模型,尽管数据集的尺寸较小,但在香草实施方面的准确性约为50%。通过特征提取和微调方法,精度提高了20%-30%,最高准确性为82.24%。此外,活动数据集中提供的结果在经验上表明,通过仔细选择通过课程学习等方法选择预训练模型数据集,可以提高准确性水平。最后,我们提供了有关帧速率对汽车模型准确性的可能影响的初步证据,未来的研究可以探索。
This paper presents an implementation on child activity recognition (CAR) with a graph convolution network (GCN) based deep learning model since prior implementations in this domain have been dominated by CNN, LSTM and other methods despite the superior performance of GCN. To the best of our knowledge, we are the first to use a GCN model in child activity recognition domain. In overcoming the challenges of having small size publicly available child action datasets, several learning methods such as feature extraction, fine-tuning and curriculum learning were implemented to improve the model performance. Inspired by the contradicting claims made on the use of transfer learning in CAR, we conducted a detailed implementation and analysis on transfer learning together with a study on negative transfer learning effect on CAR as it hasn't been addressed previously. As the principal contribution, we were able to develop a ST-GCN based CAR model which, despite the small size of the dataset, obtained around 50% accuracy on vanilla implementations. With feature extraction and fine-tuning methods, accuracy was improved by 20%-30% with the highest accuracy being 82.24%. Furthermore, the results provided on activity datasets empirically demonstrate that with careful selection of pre-train model datasets through methods such as curriculum learning could enhance the accuracy levels. Finally, we provide preliminary evidence on possible frame rate effect on the accuracy of CAR models, a direction future research can explore.