Cheetah: Bridging the Gap Between Machine Learning and Particle Accelerator Physics with High-Speed, Differentiable Simulations (2401.05815v1)
Abstract: Machine learning has emerged as a powerful solution to the modern challenges in accelerator physics. However, the limited availability of beam time, the computational cost of simulations, and the high-dimensionality of optimisation problems pose significant challenges in generating the required data for training state-of-the-art machine learning models. In this work, we introduce Cheetah, a PyTorch-based high-speed differentiable linear-beam dynamics code. Cheetah enables the fast collection of large data sets by reducing computation times by multiple orders of magnitude and facilitates efficient gradient-based optimisation for accelerator tuning and system identification. This positions Cheetah as a user-friendly, readily extensible tool that integrates seamlessly with widely adopted machine learning tools. We showcase the utility of Cheetah through five examples, including reinforcement learning training, gradient-based beamline tuning, gradient-based system identification, physics-informed Bayesian optimisation priors, and modular neural network surrogate modelling of space charge effects. The use of such a high-speed differentiable simulation code will simplify the development of machine learning-based methods for particle accelerators and fast-track their integration into everyday operations of accelerator facilities.
- K. Fujita, IEEE Access 9, 164017 (2021).
- G. Team, Gemini: A family of highly capable multimodal models (2023).
- K. Flöttmann, ASTRA – A space charge tracking algorithm (1997).
- M. Borland, in Proceedings of the 6th International Computational Accelerator Physics Conference (2000).
- CERN, MAD-X – Methodical accelerator design (1990).
- R. Roussel and A. L. Edelen, Applications of differentiable physics simulations in particle accelerator modeling (2022).
- J. Qiang, Phys. Rev. Accel. Beams 26, 024601 (2023).
- O. Stein, J. Kaiser, and A. Eichler, in Proceedings of the 13th International Particle Accelerator Conference (2022).
- https://cheetah-accelerator.readthedocs.io.
- K. L. Brown, Adv. Part. Phys. 1, 71 (1968).
- J. Rosenzweig and L. Serafini, Phys. Rev. E 49, 1599 (1994).
- F. Andreas, LatticeJSON, https://github.com/nobeam/latticejson (2019).
- E. Panofski et al., Instruments 5 (2021).
- S. Fujimoto, H. van Hoof, and D. Meger, Addressing function approximation error in actor-critic methods (2018), preprint available at https://arxiv.org/abs/1802.09477v3.
- D. P. Kingma and J. Ba, CoRR abs/1412.6980 (2014).
- C. Xu, R. Roussel, and A. Edelen, arXiv preprint arXiv:2211.09028 (2022).
- W. Falcon and The PyTorch Lightning team, PyTorch Lightning (2019).
- L. Biewald, Experiment tracking with Weights and Biases (2020), software available from wandb.com.