Real-time respiratory motion forecasting with online learning of recurrent neural networks for accurate targeting in externally guided radiotherapy (2403.01607v2)
Abstract: In lung radiotherapy, infrared cameras can track reflective objects on the chest to estimate tumor motion due to breathing, but treatment system latencies hinder radiation beam precision. Real-time recurrent learning (RTRL) is a potential solution that can learn patterns within non-stationary respiratory data but has high complexity. This study assesses the capabilities of resource-efficient online RNN algorithms, namely unbiased online recurrent optimization (UORO), sparse-1 step approximation (SnAp-1), and decoupled neural interfaces (DNI) to forecast respiratory motion during radiotherapy treatment accurately. We use time series containing the 3D positions of external markers on the chest of healthy subjects. We propose efficient implementations for SnAp-1 and DNI that compress the influence and immediate Jacobian matrices and accurately update the linear coefficients used in credit assignment estimation, respectively. Data was originally sampled at 10Hz; we resampled it at 3.33Hz and 30Hz to analyze the effect of the sampling rate on performance. We use UORO, SnAp-1, and DNI to forecast each marker's 3D position with horizons h<=2.1s (the time interval in advance for which the prediction is made) and compare them with RTRL, least mean squares, kernel support vector regression, and linear regression. RNNs trained online achieved similar or better accuracy than most previous works using larger training databases and deep learning, even though we used only the first minute of each sequence to predict motion within that exact sequence. SnAp-1 had the lowest normalized root mean square errors (nRMSEs) averaged over the horizon values considered, equal to 0.335 and 0.157, at 3.33Hz and 10.0Hz, respectively. Similarly, UORO had the lowest nRMSE at 30Hz, equal to 0.086. DNI's inference time (6.8ms per time step at 30Hz, Intel Core i7-13700 CPU) was the lowest among the RNN methods.
- Guen VL, Thome N (2021) Deep time series forecasting with shape and temporal criteria. arXiv preprint arXiv:210404610
- Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural computation 9(8):1735–1780
- Lee SJ, Motai Y (2014) Prediction and classification of respiratory motion. Springer
- Mafi M, Moghadam SM (2020) Real-time prediction of tumor motion using a dynamic neural network. Medical & biological engineering & computing 58(3):529–539
- Massé PY, Ollivier Y (2020) Convergence of online adaptive and recurrent optimization algorithms. arXiv preprint arXiv:200505645
- Subramoney A (2023) Efficient real time recurrent learning through combined activity and parameter sparsity. arXiv preprint arXiv:230305641
- Tallec C, Ollivier Y (2017) Unbiased online recurrent optimization. arXiv preprint arXiv:170205043
- Williams RJ, Zipser D (1989) A learning algorithm for continually running fully recurrent neural networks. Neural computation 1(2):270–280