Deep Learning for Time Series Classification of Parkinson's Disease Eye Tracking Data (2311.16381v1)
Abstract: Eye-tracking is an accessible and non-invasive technology that provides information about a subject's motor and cognitive abilities. As such, it has proven to be a valuable resource in the study of neurodegenerative diseases such as Parkinson's disease. Saccade experiments, in particular, have proven useful in the diagnosis and staging of Parkinson's disease. However, to date, no single eye-movement biomarker has been found to conclusively differentiate patients from healthy controls. In the present work, we investigate the use of state-of-the-art deep learning algorithms to perform Parkinson's disease classification using eye-tracking data from saccade experiments. In contrast to previous work, instead of using hand-crafted features from the saccades, we use raw $\sim1.5\,s$ long fixation intervals recorded during the preparatory phase before each trial. Using these short time series as input we implement two different classification models, InceptionTime and ROCKET. We find that the models are able to learn the classification task and generalize to unseen subjects. InceptionTime achieves $78\%$ accuracy, while ROCKET achieves $88\%$ accuracy. We also employ a novel method for pruning the ROCKET model to improve interpretability and generalizability, achieving an accuracy of $96\%$. Our results suggest that fixation data has low inter-subject variability and potentially carries useful information about brain cognitive and motor conditions, making it suitable for use with machine learning in the discovery of disease-relevant biomarkers.
- Eye movements in patients with neurodegenerative disorders. Nature Reviews Neurology, 9(2):74–85, February 2013. ISSN 1759-4766. 10.1038/nrneurol.2012.273. URL https://www.nature.com/articles/nrneurol.2012.273.
- Richard A. Armstrong. Visual Dysfunction in Parkinson’s Disease. In International Review of Neurobiology, volume 134, pages 921–946. Elsevier, 2017. ISBN 978-0-12-812603-5. URL https://linkinghub.elsevier.com/retrieve/pii/S0074774217300375.
- Classification and staging of Parkinson’s disease using video-based eye tracking. Parkinsonism & Related Disorders, 110:105316, May 2023. ISSN 13538020. 10.1016/j.parkreldis.2023.105316. URL https://linkinghub.elsevier.com/retrieve/pii/S1353802023000391.
- Motion characteristics of subclinical tremors in Parkinson’s disease and normal subjects. Scientific Reports, 12(1):4021, March 2022. ISSN 2045-2322. 10.1038/s41598-022-07957-z. URL https://www.nature.com/articles/s41598-022-07957-z.
- ROCKET: exceptionally fast and accurate time series classification using random convolutional kernels. Data Mining and Knowledge Discovery, 34(5):1454–1495, September 2020. ISSN 1573-756X. 10.1007/s10618-020-00701-z. URL https://doi.org/10.1007/s10618-020-00701-z.
- Speeding up Automatic Hyperparameter Optimization of Deep Neural Networks by Extrapolation of Learning Curves. In Proceedings of the 24th International Conference on Artificial Intelligence, IJCAI’15, pages 3460–3468. AAAI Press, 2015. ISBN 978-1-57735-738-4.
- Jeffrey L. Elman. Finding Structure in Time. Cognitive Science, 14(2):179–211, March 1990. ISSN 03640213. 10.1207/s15516709cog1402_1. URL http://doi.wiley.com/10.1207/s15516709cog1402_1.
- Johann Faouzi. Time Series Classification: A review of Algorithms and Implementations. In Machine Learning (Emerging Trends and Applications). Proud Pen, 2022. URL https://inria.hal.science/hal-03558165.
- Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour, April 2018. URL http://arxiv.org/abs/1706.02677.
- Long Short-Term Memory. Neural Computation, 9(8):1735–1780, November 1997. ISSN 0899-7667. 10.1162/neco.1997.9.8.1735.
- Deep learning for time series classification: a review. Data Mining and Knowledge Discovery, 33(4):917–963, July 2019. ISSN 1573-756X. 10.1007/s10618-019-00619-1. URL https://doi.org/10.1007/s10618-019-00619-1.
- InceptionTime: Finding AlexNet for time series classification. Data Mining and Knowledge Discovery, 34(6):1936–1962, November 2020. ISSN 1573-756X. 10.1007/s10618-020-00710-y. URL https://doi.org/10.1007/s10618-020-00710-y.
- Key challenges for delivering clinical impact with artificial intelligence. BMC Medicine, 17(1):195, October 2019. ISSN 1741-7015. 10.1186/s12916-019-1426-2. URL https://doi.org/10.1186/s12916-019-1426-2.
- Multimodal Learning and Intelligent Prediction of Symptom Development in Individual Parkinson’s Patients. Sensors, 16(9):1498, September 2016. ISSN 1424-8220. 10.3390/s16091498. URL https://www.mdpi.com/1424-8220/16/9/1498.
- Machine Learning and Eye Movements Give Insights into Neurodegenerative Disease Mechanisms. Sensors, 23(4):2145, January 2023. ISSN 1424-8220. 10.3390/s23042145. URL https://www.mdpi.com/1424-8220/23/4/2145.
- Cortical correlates of the basic and first harmonic frequency of Parkinsonian tremor. Clinical Neurophysiology, 120(10):1866–1872, October 2009. ISSN 13882457. 10.1016/j.clinph.2009.06.028. URL https://linkinghub.elsevier.com/retrieve/pii/S138824570900488X.
- AI in health and medicine. Nature Medicine, 28(1):31–38, January 2022. ISSN 1546-170X. 10.1038/s41591-021-01614-0. URL https://www.nature.com/articles/s41591-021-01614-0.
- The great multivariate time series classification bake off: a review and experimental evaluation of recent algorithmic advances. Data Mining and Knowledge Discovery, 35(2):401–449, March 2021. ISSN 1384-5810, 1573-756X. 10.1007/s10618-020-00727-3. URL http://link.springer.com/10.1007/s10618-020-00727-3.
- Measurements of Antisaccades Parameters Can Improve the Prediction of Parkinson’s Disease Progression. In Intelligent Information and Database Systems, volume 11432, pages 602–614. Springer International Publishing, Cham, 2019. ISBN 978-3-030-14801-0 978-3-030-14802-7. URL http://link.springer.com/10.1007/978-3-030-14802-7_52.
- Pro-Saccades Predict Cognitive Decline in Parkinson’s Disease: ICICLE-PD. Movement Disorders, 34(11):1690–1698, 2019. ISSN 1531-8257. 10.1002/mds.27813. URL https://onlinelibrary.wiley.com/doi/abs/10.1002/mds.27813.
- Going Deeper with Convolutions. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1–9, Boston, MA, USA, June 2015. IEEE. ISBN 978-1-4673-6964-0. 10.1109/CVPR.2015.7298594. URL http://ieeexplore.ieee.org/document/7298594/.
- Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning. Proceedings of the AAAI Conference on Artificial Intelligence, 31(1), February 2017. ISSN 2374-3468. 10.1609/aaai.v31i1.11231. URL https://ojs.aaai.org/index.php/AAAI/article/view/11231.
- The diagnostic value of saccades in movement disorder patients: a practical guide and review. Journal of Clinical Movement Disorders, 2(1):14, October 2015. ISSN 2054-7072. 10.1186/s40734-015-0025-4. URL https://doi.org/10.1186/s40734-015-0025-4.
- Fixation Duration and Pupil Size as Diagnostic Tools in Parkinson’s Disease. Journal of Parkinson’s Disease, 11(2):865–875, January 2021. ISSN 1877-7171. 10.3233/JPD-202427. URL https://content.iospress.com/articles/journal-of-parkinsons-disease/jpd202427.
- Dynamical time series embeddings in recurrent neural networks. Chaos, Solitons & Fractals, 154:111612, January 2022. ISSN 0960-0779. 10.1016/j.chaos.2021.111612. URL https://www.sciencedirect.com/science/article/pii/S0960077921009668.
- Detach-rocket: Sequential feature selection for time series classification with random convolutional kernels. 2023. 10.48550/arXiv.2309.14518. URL https://arxiv.org/abs/2309.14518.
- Laurens Van der Maaten and Geoffrey Hinton. Visualizing data using t-SNE. Journal of machine learning research, 9(11), 2008.
- Vertical saccades and antisaccades: complementary markers for motor and cognitive impairment in Parkinson’s disease. npj Parkinson’s Disease, 5(1):1–6, June 2019. ISSN 2373-8057. 10.1038/s41531-019-0083-7. URL https://www.nature.com/articles/s41531-019-0083-7.
- Neural correlates of impaired response inhibition in the antisaccade task in Parkinson’s disease. Behavioural Brain Research, 422:113763, March 2022. ISSN 0166-4328. 10.1016/j.bbr.2022.113763. URL https://www.sciencedirect.com/science/article/pii/S0166432822000316.
- Cluster analysis reveals distinct patterns of saccade impairment and their relation to cognitive profiles in Parkinson’s disease. Journal of Neuropsychology, 17(2):251–263, June 2023. ISSN 1748-6645, 1748-6653. 10.1111/jnp.12302. URL https://bpspsychub.onlinelibrary.wiley.com/doi/10.1111/jnp.12302.
- Time series shapelets: a novel technique that allows accurate, interpretable and fast classification. Data Mining and Knowledge Discovery, 22(1):149–182, January 2011. ISSN 1573-756X. 10.1007/s10618-010-0179-5. URL https://doi.org/10.1007/s10618-010-0179-5.