论文标题
连续转移学习具有标签的分布对齐
Continuous Transfer Learning with Label-informed Distribution Alignment
论文作者
论文摘要
转移学习已成功应用于许多高影响应用程序。但是,大多数现有的工作都集中在静态转移学习设置上,而很少有专门用于建模时间不断发展的目标域,例如电影的在线评论。为了弥合这一差距,在本文中,我们研究了一个新颖的连续传输学习设置,并以时间不断发展的目标域。与持续转移学习相关的一个主要挑战是随着目标域的发展,负转移的可能发生。为了应对这一挑战,我们提出了一种新颖的标记为源和目标域之间的标签信息,以衡量数据分布的转移以及识别潜在的负转移。然后,我们使用我们提出的c-Divergence的经验估计来得出目标域绑定的误差。此外,我们提出了一个通用的对抗变异自动编码器框架,该框架是通过最小化分类误差和在潜在特征空间中连续的时间戳之间的分类误差和目标域的c差异。此外,我们定义了一个转移签名,用于根据c-divergence表征负转移,这表明较大的c差异意味着在实际情况下负转移的概率更高。关于合成和真实数据集的广泛实验证明了我们翻译框架的有效性。
Transfer learning has been successfully applied across many high-impact applications. However, most existing work focuses on the static transfer learning setting, and very little is devoted to modeling the time evolving target domain, such as the online reviews for movies. To bridge this gap, in this paper, we study a novel continuous transfer learning setting with a time evolving target domain. One major challenge associated with continuous transfer learning is the potential occurrence of negative transfer as the target domain evolves over time. To address this challenge, we propose a novel label-informed C-divergence between the source and target domains in order to measure the shift of data distributions as well as to identify potential negative transfer. We then derive the error bound for the target domain using the empirical estimate of our proposed C-divergence. Furthermore, we propose a generic adversarial Variational Auto-encoder framework named TransLATE by minimizing the classification error and C-divergence of the target domain between consecutive time stamps in a latent feature space. In addition, we define a transfer signature for characterizing the negative transfer based on C-divergence, which indicates that larger C-divergence implies a higher probability of negative transfer in real scenarios. Extensive experiments on synthetic and real data sets demonstrate the effectiveness of our TransLATE framework.