论文标题
使用流形学习的深度学习方法完成矩阵完成
Deep Learning Approach for Matrix Completion Using Manifold Learning
论文作者
论文摘要
由于其在各个研究领域的广泛应用,因此矩阵的完成受到了广泛的关注和研究。现有的矩阵完成方法仅考虑数据矩阵中条目之间的非线性(或线性)关系,而忽略了线性(或非线性)关系。本文介绍了一个新的数据矩阵潜在变量模型,该模型是线性和非线性模型的组合,并设计了一种新型的基于深神经网络的矩阵完成算法,以解决数据矩阵条目之间的线性和非线性关系。提出的方法由两个分支组成。第一个分支通过一系列隐藏的神经网络层了解列的潜在表示,并重建部分观察到的矩阵的列。第二个分支对行进行相同的操作。此外,根据多任务学习原则,我们强制执行这两个分支,并引入一种新的正则化技术来减少过度拟合。更具体地说,丢失的数据条目被恢复为主要任务,并将多种多样的学习作为辅助任务执行。辅助任务限制了网络的权重,因此可以将其视为正规器,改善主要任务并减少过度拟合。与最先进的矩阵完成方法相比,在合成数据和几个现实世界数据上获得的实验结果验证了所提出方法的有效性。
Matrix completion has received vast amount of attention and research due to its wide applications in various study fields. Existing methods of matrix completion consider only nonlinear (or linear) relations among entries in a data matrix and ignore linear (or nonlinear) relationships latent. This paper introduces a new latent variables model for data matrix which is a combination of linear and nonlinear models and designs a novel deep-neural-network-based matrix completion algorithm to address both linear and nonlinear relations among entries of data matrix. The proposed method consists of two branches. The first branch learns the latent representations of columns and reconstructs the columns of the partially observed matrix through a series of hidden neural network layers. The second branch does the same for the rows. In addition, based on multi-task learning principles, we enforce these two branches work together and introduce a new regularization technique to reduce over-fitting. More specifically, the missing entries of data are recovered as a main task and manifold learning is performed as an auxiliary task. The auxiliary task constrains the weights of the network so it can be considered as a regularizer, improving the main task and reducing over-fitting. Experimental results obtained on the synthetic data and several real-world data verify the effectiveness of the proposed method compared with state-of-the-art matrix completion methods.