论文标题
捕获22的水库计算
Catch-22s of reservoir computing
论文作者
论文摘要
储层计算(RC)是一个简单有效的无模型框架,用于预测数据中非线性动态系统的行为。在这里,我们表明存在普遍研究的系统,除非已经知道有关基础系统的关键信息,否则领先的RC框架很难学习动态。我们专注于盆地预测的重要问题 - 确定系统将从其初始条件中汇聚到哪种吸引子。首先,我们表明,标准RC模型(回声状态网络)的预测非常依赖于热身时间,需要几乎包含整个瞬态的热身轨迹才能识别正确的吸引子。因此,我们转向下一代储层计算(NGRC),这是RC的有吸引力的变体,需要可忽略不计的热身时间。通过将确切的非线性纳入原始方程式,我们表明NGRC即使使用稀疏的训练数据(例如,单个瞬态轨迹),NGRC即使具有稀疏的训练数据,也可以准确地重建具有复杂和高维的吸引力盆地。但是,确切的非线性的微小不确定性可以使预测准确性比机会更好。我们的结果强调了数据驱动方法在学习多稳定系统的动态方面面临的挑战,并提出了使这些方法更强大的潜在途径。
Reservoir Computing (RC) is a simple and efficient model-free framework for forecasting the behavior of nonlinear dynamical systems from data. Here, we show that there exist commonly-studied systems for which leading RC frameworks struggle to learn the dynamics unless key information about the underlying system is already known. We focus on the important problem of basin prediction -- determining which attractor a system will converge to from its initial conditions. First, we show that the predictions of standard RC models (echo state networks) depend critically on warm-up time, requiring a warm-up trajectory containing almost the entire transient in order to identify the correct attractor. Accordingly, we turn to Next-Generation Reservoir Computing (NGRC), an attractive variant of RC that requires negligible warm-up time. By incorporating the exact nonlinearities in the original equations, we show that NGRC can accurately reconstruct intricate and high-dimensional basins of attraction, even with sparse training data (e.g., a single transient trajectory). Yet, a tiny uncertainty in the exact nonlinearity can render prediction accuracy no better than chance. Our results highlight the challenges faced by data-driven methods in learning the dynamics of multistable systems and suggest potential avenues to make these approaches more robust.