Human Motor Learning Dynamics in High-dimensional Tasks (2404.13258v1)
Abstract: Conventional approaches to enhancing movement coordination, such as providing instructions and visual feedback, are often inadequate in complex motor tasks with multiple degrees of freedom (DoFs). To effectively address coordination deficits in such complex motor systems, it becomes imperative to develop interventions grounded in a model of human motor learning; however, modeling such learning processes is challenging due to the large DoFs. In this paper, we present a computational motor learning model that leverages the concept of motor synergies to extract low-dimensional learning representations in the high-dimensional motor space and the internal model theory of motor control to capture both fast and slow motor learning processes. We establish the model's convergence properties and validate it using data from a target capture game played by human participants. We study the influence of model parameters on several motor learning trade-offs such as speed-accuracy, exploration-exploitation, satisficing, and flexibility-performance, and show that the human motor learning system tunes these parameters to optimize learning and various output performance metrics.
- Sensitivity derivatives for flexible sensorimotor learning. Neural Computation, 20(8):2085–2111, 2008.
- Subject-specific assist-as-needed controllers for a hand exoskeleton for rehabilitation. IEEE Robotics and Automation Letters, 3(1):508–515, 2017.
- A framework for adaptation of training task, assistance and feedback for optimizing motor (re)-learning with a robotic exoskeleton. IEEE Robotics and Automation Letters, 4(2):808–815, 2019.
- The effects of motor modularity on performance, learning and generalizability in upper-extremity reaching: a computational analysis. Journal of the Royal Society Interface, 17(167):20200011, 2020.
- Simplified and effective motor control based on muscle synergies to exploit musculoskeletal dynamics. Proceedings of the National Academy of Sciences, 106(18):7601–7606, 2009.
- NA Bernstein’s. The Coordination and Regulation of Movements. Oxford: Pergamon Press Ltd, 1967.
- Cognitive Modeling. Sage, 2010.
- Dissociating error-based and reinforcement-based loss functions during sensorimotor learning. PLoS Computational Biology, 13(7):e1005623, 2017.
- Assist-as-needed exoskeleton for hand joint rehabilitation based on muscle effort detection. Sensors, 21(13):4372, 2021.
- Size of error affects cerebellar contributions to motor learning. Journal of Neurophysiology, 103(4):2275–2284, 2010.
- The influence of visual motion on motor learning. Journal of Neuroscience, 32(29):9859–9869, 2012.
- A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation, 6(2):182–197, 2002.
- Locomotor primitives in newborn babies and their development. Science, 334(6058):997–999, 2011.
- Quantifying generalization from trial-by-trial behavior of adaptive systems that learn with basis functions: Theory and experiments in human motor control. Journal of Neuroscience, 23(27):9032–9045, 2003.
- Brain regions controlling nonsynergistic versus synergistic movement of the digits: A functional magnetic resonance imaging study. Journal of Neuroscience, 22(12):5074–5080, 2002.
- Paul M Fitts. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 47(6):381, 1954.
- Motor primitives in vertebrates and invertebrates. Current Opinion in Neurobiology, 15(6):660–666, 2005.
- Modular organization of finger movements by the human central nervous system. Neuron, 52(4):731–742, 2006.
- Encoding of motor skill in the corticomuscular system of musicians. Current Biology, 20(20):1869–1874, 2010.
- The binding of learning to action in motor adaptation. PLoS Computational Biology, 7(6):e1002052, 2011.
- A memory of errors in sensorimotor learning. Science, 345(6202):1349–1353, 2014.
- Contribution of explicit processes to reinforcement-based motor learning. Journal of Neurophysiology, 119(6):2241–2255, 2018.
- Robust Adaptive Control, volume 1. PTR Prentice-Hall Upper Saddle River, NJ, 1996.
- Forward models: Supervised learning with a distal teacher. Cognitive Science, 16(3):307–354, 1992.
- Towards modeling human motor learning dynamics in high-dimensional spaces. In American Control Conference, pages 683–688, Atlanta, GA, 2022.
- H. K. Khalil. Nonlinear Systems. Prentice Hall, third edition, 2002.
- Ghilardi MF Krakauer, John W and Ghez C. Independent learning of internal models for kinematic and dynamic control of reaching. Nature Neuroscience, 2:1026–1031, 1999.
- John W Krakauer. Motor learning: its relevance to stroke recovery and neurorehabilitation. Current Opinion in Neurology, 19(1):84–90, 2006.
- Motor learning. Comprehensive Physiology, 9(2):613–663, 2019.
- Human sensorimotor learning: adaptation, skill, and beyond. Current Opinion in Neurobiology, 21(4):636–644, 2011.
- Harold Joseph Kushner. Introduction to Stochastic Control. Holt, Rinehart and Winston New York, 1971.
- A synergy-based hand control is encoded in human motor cortical areas. eLife, 5:e13420, feb 2016.
- Persistency of excitation criteria for linear, multivariable, time-varying systems. Mathematics of Control, Signals and Systems, 1:203–226, 1988.
- Preparatory activity in motor cortex reflects learning of local visuomotor skills. Nature Neuroscience, 6(8):882–890, 2003.
- The dynamics of motor learning through the formation of internal models. PLoS Computational Biology, 15(12):e1007118, 2019.
- Learning to be lazy: Exploiting redundancy in a novel task to minimize movement-related effort. Journal of Neuroscience, 33(7):2754–2760, 2013.
- Wearable technologies for hand joints monitoring for rehabilitation: A survey. Microelectronics Journal, 88:173–183, 2019.
- David A Rosenbaum. Human Motor Control. Academic Press, 2009.
- Neural bases of hand synergies. Frontiers in Computational Neuroscience, 7:23, 2013.
- Postural hand synergies for tool use. Journal of Neuroscience, 18(23):10105–10115, 1998.
- Adaptive Control: Stability, Convergence, and Robustness. Prentice-Hall, Inc., 1989.
- Adaptive representation of dynamics during learning of a motor task. Journal of Neuroscience, 14(5):3208–3224, 1994.
- Herbert A Simon. Rational choice and the structure of the environment. Psychological Review, 63(2):129, 1956.
- Interacting adaptive processes with different timescales underlie short-term motor learning. PLoS Biology, 4(6):e179, 2006.
- Dagmar Sternad. It’s not (only) the mean that matters: variability, noise and exploration in skill learning. Current Opinion in Behavioral Sciences, 20:183–195, 2018.
- Reinforcement Learning: An Introduction. MIT Press, 1998.
- Flexible cognitive strategies during motor learning. PLoS Computational Biology, 7(3):e1001096, 2011.
- Matrix factorization algorithms for the identification of muscle synergies: Evaluation on simulated and experimental data sets. Journal of Neurophysiology, 95(4):2199–2212, 2006.
- Sensory prediction errors drive cerebellum-dependent adaptation of reaching. Journal of Neurophysiology, 98(1):54–62, 2007.
- Elaborated reichardt detectors. JOSA A, 2(2):300–321, 1985.
- Dimensionality reduction in control and coordination of the human hand. IEEE Transactions on Biomedical Engineering, 57(2):284–295, 2010.
- Internal models in the cerebellum. Trends in Cognitive Sciences, 2(9):338–347, 1998.
- Design and development of a hand exoskeleton for rehabilitation of hand injuries. Mechanism and Machine Theory, 73:103–116, 2014.