Identify tasks where Reservoir Computing with Cellular Automata is most beneficial

Determine the classes of computational tasks and data characteristics for which Reservoir Computing with Cellular Automata (ReCA)—comprising a binary encoding, an Elementary Cellular Automaton reservoir with a small number of iterations, and a linear readout—provides measurable performance benefits over ablations that exclude the cellular automaton or use only the encoding and linear classifier. Clarify whether properties such as locality versus globality of features, temporal dependence, or input dimensionality predict when ReCA is advantageous.

Background

The paper tests ReCA on binarized MNIST (bMNIST) and across the UCR Time Series Classification Archive. ReCA substantially improves performance on bMNIST for many ECA rules, while on UCR the advantage disappears once ablation reveals that the similarity-preserving expanded encoding (SimExp) alone accounts for the gains. This contrast motivates a need to understand the problem types and feature structures under which the CA reservoir contributes useful transformations beyond the encoding and linear readout.

References

This highlights the need for ablation testing, i.e., comparing internally with sub-parts of one model, but also raises an open question on what kind of tasks ReCA is best suited for.

On when is Reservoir Computing with Cellular Automata Beneficial? (2407.09501 - Glover et al., 13 Jun 2024) in Abstract