论文标题
用于体现控制的神经回路建筑先验
Neural Circuit Architectural Priors for Embodied Control
论文作者
论文摘要
用于运动控制的人工神经网络通常采用通用体系结构,例如完全连接的MLP。虽然一般,但这些Tabula Rasa架构依靠大量的经验来学习,不容易转移到新的身体,并且具有难以解释的内部动力。在自然界中,动物天生在其神经系统中具有高度结构化的连通性。这种先天回路通过学习机制协同起作用,以提供诱导性偏见,使大多数动物在出生后不久就能发挥作用并有效地学习。受视觉电路启发的卷积网络已经编码了有用的偏见以进行视觉。但是,未知的ANN体系结构受神经回路的启发可以产生其他AI域的有用偏见。在这项工作中,我们询问具有生物学启发的ANN体系结构可以在电动机控制领域提供什么优势。具体而言,我们将秀丽隐杆线虫运动电路转换为控制模拟游泳者的ANN模型。在运动任务上,我们的体系结构实现了良好的初始性能和与MLP相当的渐近性能,同时显着提高了数据效率,并且需要较少的参数订单。我们的体系结构是可解释的,并转移到新的身体设计上。消融分析表明,受限的激发/抑制对于学习至关重要,而体重初始化有助于良好的初始性能。我们的工作证明了生物学启发的ANN体系结构的几个优势,并鼓励了更复杂的体现控制中的未来工作。
Artificial neural networks for motor control usually adopt generic architectures like fully connected MLPs. While general, these tabula rasa architectures rely on large amounts of experience to learn, are not easily transferable to new bodies, and have internal dynamics that are difficult to interpret. In nature, animals are born with highly structured connectivity in their nervous systems shaped by evolution; this innate circuitry acts synergistically with learning mechanisms to provide inductive biases that enable most animals to function well soon after birth and learn efficiently. Convolutional networks inspired by visual circuitry have encoded useful biases for vision. However, it is unknown the extent to which ANN architectures inspired by neural circuitry can yield useful biases for other AI domains. In this work, we ask what advantages biologically inspired ANN architecture can provide in the domain of motor control. Specifically, we translate C. elegans locomotion circuits into an ANN model controlling a simulated Swimmer agent. On a locomotion task, our architecture achieves good initial performance and asymptotic performance comparable with MLPs, while dramatically improving data efficiency and requiring orders of magnitude fewer parameters. Our architecture is interpretable and transfers to new body designs. An ablation analysis shows that constrained excitation/inhibition is crucial for learning, while weight initialization contributes to good initial performance. Our work demonstrates several advantages of biologically inspired ANN architecture and encourages future work in more complex embodied control.