论文标题
大规模光子储层计算机的贝叶斯优化
Bayesian optimisation of large-scale photonic reservoir computers
论文作者
论文摘要
介绍。储层计算是一个日益增长的范式,用于简化复发性神经网络的培训,具有很高的硬件实现潜力。光学和电子产品的许多实验产生的性能与数字最新算法相当。该领域的许多最新作品都集中在大型光子系统上,具有成千上万的物理节点和任意互连。尽管这种趋势显着扩大了光子储存计算的潜在应用,但它也使系统的高参数数量的优化复杂化。方法。在这项工作中,我们建议使用贝叶斯优化以有效地探索最小迭代数量的高参数空间。结果。我们在先前报道的大规模实验系统上测试了这种方法,将其与常用的网格搜索进行比较,并报告性能的显着改善以及优化超参数所需的实验迭代次数。结论。因此,贝叶斯优化有可能成为调整光子储量计算中超参数的标准方法。
Introduction. Reservoir computing is a growing paradigm for simplified training of recurrent neural networks, with a high potential for hardware implementations. Numerous experiments in optics and electronics yield comparable performance to digital state-of-the-art algorithms. Many of the most recent works in the field focus on large-scale photonic systems, with tens of thousands of physical nodes and arbitrary interconnections. While this trend significantly expands the potential applications of photonic reservoir computing, it also complicates the optimisation of the high number of hyper-parameters of the system. Methods. In this work, we propose the use of Bayesian optimisation for efficient exploration of the hyper-parameter space in a minimum number of iteration. Results. We test this approach on a previously reported large-scale experimental system, compare it to the commonly used grid search, and report notable improvements in performance and the number of experimental iterations required to optimise the hyper-parameters. Conclusion. Bayesian optimisation thus has the potential to become the standard method for tuning the hyper-parameters in photonic reservoir computing.