Effect of temporal resolution on the reproduction of chaotic dynamics via reservoir computing (2302.10761v2)
Abstract: Reservoir computing is a machine learning paradigm that uses a structure called a reservoir, which has nonlinearities and short-term memory. In recent years, reservoir computing has expanded to new functions such as the autonomous generation of chaotic time series, as well as time series prediction and classification. Furthermore, novel possibilities have been demonstrated, such as inferring the existence of previously unseen attractors. Sampling, in contrast, has a strong influence on such functions. Sampling is indispensable in a physical reservoir computer that uses an existing physical system as a reservoir because the use of an external digital system for the data input is usually inevitable. This study analyzes the effect of sampling on the ability of reservoir computing to autonomously regenerate chaotic time series. We found, as expected, that excessively coarse sampling degrades the system performance, but also that excessively dense sampling is unsuitable. Based on quantitative indicators that capture the local and global characteristics of attractors, we identify a suitable window of the sampling frequency and discuss its underlying mechanisms.
- Herbert Jaeger. The “echo state” approach to analysing and training recurrent neural networks - with an Erratum note 1. GMD Report, pages 1–47, 2010.
- Real-time computing without stable states: A new framework for neural computation based on perturbations. Neural Computation, 14(11):2531–2560, 2002.
- Photonic neural field on a silicon chip: large-scale, high-speed neuro-inspired computing and sensing. Optica, 8(11):1388, 2021.
- Kohei Nakajima. Reservoir computing theory, physical implementations, and applications. Springer, Jan 2021.
- Reservoir Computing with Diverse Timescales for Prediction of Multiscale Dynamics. Phys. Rev. Research, 032014:1–7, 2021.
- Connecting reservoir computing with statistical forecasting and deep neural networks. Nature Communications, 13(1):5–7, 2022.
- Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication. Science, 304(5667):78–80, 2004.
- Good and bad predictions: Assessing and improving the replication of chaotic attractors by means of reservoir computing. Chaos, 29(10), 2019.
- Forecasting chaotic systems with very low connectivity reservoir computers. Chaos, 29(12), 2019.
- Attractor reconstruction by machine learning. Chaos, 28(6), 2018.
- Reservoir Computing Universality with Stochastic Inputs. IEEE Transactions on Neural Networks and Learning Systems, 31(1):100–112, 2020.
- The analysis of observed chaotic data in physical systems. Rev. Mod. Phys., 65:1331–1392, Oct 1993.
- Model-free inference of unseen attractors: Reconstructing phase space features from a single noisy trajectory using reservoir computing. Chaos, 31(10), 2021.
- Photonic information processing beyond Turing: an optoelectronic implementation of reservoir computing. Optics Express, 20(3):3241, 2012.
- Information processing via physical soft body. Scientific Reports, 5:1–11, 2015.
- Pneumatic reservoir computing for sensing soft body: Computational ability of air in tube and its application to posture estimation of soft exoskeleton. Sensors and Materials, 33(8):2803–2824, 2021.
- Reservoir Computing with Spin Waves Excited in a Garnet Film. IEEE Access, 6:4462–4469, 2018.
- Large-Scale Optical Reservoir Computing for Spatiotemporal Chaotic Systems Prediction. Physical Review X, 10(4):41037, 2020.
- Cross-predicting the dynamics of an optically injected single-mode semiconductor laser using reservoir computing. Chaos, 29(11), 2019.
- Edward N Lorenz. Lorenz Deterministic Nonperiodic Flow, 1962.
- O. E. Rössler. An equation for continuous chaos. Physics Letters A, 57(5):397–398, 1976.
- F. Wyffels and B. Schrauwen. A comparative study of Reservoir Computing strategies for monthly time series prediction. Neurocomputing, 73(10-12):1958–1964, 2010.
- Joy A. Thomas Thomas M. Cover. Elements of information theory, 2nd edition. Wiley-Interscience, 2006.