PD-Insighter: A Visual Analytics System to Monitor Daily Actions for Parkinson's Disease Treatment (2404.10661v1)
Abstract: People with Parkinson's Disease (PD) can slow the progression of their symptoms with physical therapy. However, clinicians lack insight into patients' motor function during daily life, preventing them from tailoring treatment protocols to patient needs. This paper introduces PD-Insighter, a system for comprehensive analysis of a person's daily movements for clinical review and decision-making. PD-Insighter provides an overview dashboard for discovering motor patterns and identifying critical deficits during activities of daily living and an immersive replay for closely studying the patient's body movements with environmental context. Developed using an iterative design study methodology in consultation with clinicians, we found that PD-Insighter's ability to aggregate and display data with respect to time, actions, and local environment enabled clinicians to assess a person's overall functioning during daily life outside the clinic. PD-Insighter's design offers future guidance for generalized multiperspective body motion analytics, which may significantly improve clinical decision-making and slow the functional decline of PD and other medical conditions.
- [n. d.]. RealityCapture - 3D Models from Photos and/or Laser Scans. https://www.capturingreality.com/?utm_source=GoogleAds&utm_medium=cpc&utm_campaign=general_Amerika&utm_source=GoogleSearch&utm_medium=Performance&utm_campaign=&utm_adgroup=&utm_content=&utm_term=realitycapture
- 2023. zju3dv/EasyMocap. https://github.com/zju3dv/EasyMocap
- Sequence Surveyor: Leveraging Overview for Scalable Genomic Alignment Visualization. IEEE Transactions on Visualization and Computer Graphics 17, 12 (Dec. 2011), 2392–2401. https://doi.org/10.1109/TVCG.2011.232
- Telemonitoring for Assisted Living Residences: The Medical Specialists’ View. Proceedings of The National Academy of Sciences (PNAS) (Jan. 2011), 78.
- Q. J. Almeida and C. A. Lebold. 2010. Freezing of gait in Parkinson’s disease: a perceptual cause for a motor impairment? Journal of Neurology, Neurosurgery, and Psychiatry 81, 5 (May 2010), 513–518. https://doi.org/10.1136/jnnp.2008.160580
- Prevalence and associated features of self-reported freezing of gait in Parkinson disease: The DEEP FOG study. Parkinsonism & Related Disorders 21, 6 (June 2015), 644–649. https://doi.org/10.1016/j.parkreldis.2015.03.028
- YouMove: enhancing movement training with an augmented reality mirror. In Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, St. Andrews Scotland, United Kingdom, 311–320. https://doi.org/10.1145/2501988.2502045
- Mobolaji Ayoade and Lynne Baillie. 2014. A novel knee rehabilitation system for the home. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Toronto Ontario Canada, 2521–2530. https://doi.org/10.1145/2556288.2557353
- The smart condo: visualizing independent living environments in a virtual world. 3d International ICST Conference on Pervasive Computing Technologies for Healthcare (April 2009), 8. https://doi.org/10.4108/ICST.PERVASIVEHEALTH2009.6020
- What’s the Situation with Situated Visualization? A Survey and Perspectives on Situatedness. IEEE Transactions on Visualization and Computer Graphics 28, 1 (Jan. 2022), 107–117. https://doi.org/10.1109/TVCG.2021.3114835
- Jessica L. Burpee and Michael D. Lewek. 2015. Biomechanical gait characteristics of naturally occurring unsuccessful foot clearance during swing in individuals with chronic stroke. Clinical Biomechanics (Bristol, Avon) 30, 10 (Dec. 2015), 1102–1107. https://doi.org/10.1016/j.clinbiomech.2015.08.018
- Mobile. Egocentric Human Body Motion Reconstruction Using Only Eyeglasses-mounted Cameras and a Few Body-worn Inertial Sensors. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 616–625. https://doi.org/10.1109/VR50410.2021.00087
- A new quantitative method for evaluating freezing of gait and dual-attention task deficits in Parkinson’s disease. Journal of Neural Transmission 122, 11 (Nov. 2015), 1523–1531. https://doi.org/10.1007/s00702-015-1423-3
- Visualizing virus population variability from next generation sequencing data. In 2011 IEEE Symposium on Biological Data Visualization (BioVis). 135–142. https://doi.org/10.1109/BioVis.2011.6094058
- J. R. K. Kumar Dabbakuti and Nalini Kotnana. 2012. Design and Implementation of Portable Health Monitoring system using PSoC Mixed Signal Array chip. https://www.semanticscholar.org/paper/Design-and-Implementation-of-Portable-Health-system-Dabbakuti-Kotnana/00da3c347e95b00a069e6c149dbb92b31aad9af3
- The Parkinson’s Disease Activities of Daily Living, Interference, and Dependence Instrument. Movement Disorders Clinical Practice 6, 8 (Sept. 2019), 678–686. https://doi.org/10.1002/mdc3.12833
- Body-worn sensors for remote monitoring of Parkinson’s disease motor symptoms: vision, state of the art, and challenges ahead. Journal of Parkinson’s disease 11, s1 (2021), S35–S47.
- A Comprehensive Review of Automated Data Annotation Techniques in Human Activity Recognition. https://doi.org/10.48550/arXiv.2307.05988
- Impaired Weight-Shift Amplitude in People with Parkinson’s Disease with Freezing of Gait. Journal of Parkinson’s Disease 11, 3 (Jan. 2021), 1367–1380. https://doi.org/10.3233/JPD-202370
- Moving Parkinson care to the home. Movement Disorders 31, 9 (2016), 1258–1262.
- BASE - An interactive technology solution to deliver balance and strength exercises to older adults. 4th International ICST Conference on Pervasive Computing Technologies for Healthcare (Jan. 2010), 5. https://doi.org/10.4108/ICST.PERVASIVEHEALTH2010.8881
- Grand Challenges in Immersive Analytics. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). Association for Computing Machinery, New York, NY, USA, 1–17. https://doi.org/10.1145/3411764.3446866
- HAExplorer: Understanding Interdependent Biomechanical Motions with Interactive Helical Axes. In SIGCHI Conference on Human Factors in Computing Systems (CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–16. https://doi.org/10.1145/3491102.3501841
- ShadowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. ACM, Banff Alberta Canada, 165–172. https://doi.org/10.1145/1731903.1731935
- Jaime Garcia and Karla Felix Navarro. 2014. The Mobile RehApp(TM): an AR-based mobile game for ankle sprain rehabilitation. IEEE International Conference on Serious Games and Applications for Health (SeGAH) (May 2014). https://doi.org/10.1109/SeGAH.2014.7067087
- Data visualisation and data mining technology for supporting care for older people. 146 pages. https://doi.org/10.1145/1296843.1296868
- Normal and pathological gait: what we learn from Parkinson’s disease. Journal of Neurology, Neurosurgery, and Psychiatry 83, 10 (Oct. 2012), 979–985. https://doi.org/10.1136/jnnp-2012-302263
- Mark Harrower and Cynthia A. Brewer. 2003. ColorBrewer.org: An Online Tool for Selecting Colour Schemes for Maps. The Cartographic Journal 40, 1 (June 2003), 27–37. https://doi.org/10.1179/000870403235002042
- Estimating depth information of vascular models: A comparative user study between a virtual reality and a desktop application. Computers & Graphics 98 (2021), 210–217.
- InfoSPOT: A mobile Augmented Reality method for accessing building information through a situation awareness approach. Automation in Construction 33 (Aug. 2013), 11–23. https://doi.org/10.1016/j.autcon.2012.09.002
- Validation of Automated Mobility Assessment Using a Single 3D Sensor. Vol. 9914. https://doi.org/10.1007/978-3-319-48881-3_12
- Towards Situated Knee Trajectory Visualization for Self Analysis in Cycling. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Reutlingen, 595–596. https://doi.org/10.1109/VR.2018.8446212
- Interactive Coordinated Multiple-View Visualization of Biomechanical Motion Data. IEEE Transactions on Visualization and Computer Graphics 15, 6 (Nov. 2009), 1383–1390. https://doi.org/10.1109/TVCG.2009.152
- Immersive analysis of user motion in VR applications. The Visual Computer 36, 10 (Oct. 2020), 1937–1949. https://doi.org/10.1007/s00371-020-01942-1
- Ranjit Kolkar and Geetha V. 2023. Human Activity Behavioural Pattern Recognition in Smarthome with Long-hour Data Collection. http://arxiv.org/abs/2306.13374
- The Value of Immersive Visualization. IEEE computer graphics and applications 41, 4 (2021), 125–132. https://doi.org/10.1109/MCG.2021.3075258
- Data Visceralization: Enabling Deeper Understanding of Data Using Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 27, 2 (Feb. 2021), 1095–1105. https://doi.org/10.1109/TVCG.2020.3030435
- Arm swing magnitude and asymmetry during gait in the early stages of Parkinson’s disease. Gait & Posture 31, 2 (Feb. 2010), 256–260. https://doi.org/10.1016/j.gaitpost.2009.10.013
- Towards an Understanding of Situated AR Visualization for Basketball Free-Throw Training. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13. https://doi.org/10.1145/3411764.3445649
- Learning To Recognize Procedural Activities with Distant Supervision. https://doi.org/10.48550/arXiv.2201.10990
- PEARL: Physical Environment based Augmented Reality Lenses for In-Situ Human Movement Analysis. https://doi.org/10.1145/3544548.3580715
- F. I. Mahoney and D. W. Barthel. 1965. Functional Evaluation: The Barathel Index. Maryland State Medical Journal 14 (Feb. 1965), 61–65.
- Artificial Intelligence of Things- (AIoT-) Based Patient Activity Tracking System for Remote Patient Monitoring. Journal of Healthcare Engineering 2022 (March 2022), 1–15. https://doi.org/10.1155/2022/8732213
- Immersive Analytics. Lecture Notes in Computer Science, Vol. 11190. Springer International Publishing, Cham. https://doi.org/10.1007/978-3-030-01388-2
- Motor symptoms in Parkinson’s disease: A unified framework. Neuroscience and Biobehavioral Reviews 68 (Sept. 2016), 727–740. https://doi.org/10.1016/j.neubiorev.2016.07.010
- Visualization of data for ambient assisted living services. IEEE Communications Magazine 49, 1 (Jan. 2011), 110–117. https://doi.org/10.1109/MCOM.2011.5681023
- Mining Human Mobility to Quantify Performance Status. 1177 pages. https://doi.org/10.1109/ICDMW.2017.168
- LifeLines: Using Visualization to Enhance Navigation and Analysis of Patient Records. In The Craft of Information Visualization. Morgan Kaufmann, San Francisco, 308–312. https://doi.org/10.1016/B978-155860915-0/50038-X
- How Therapists Use Visualizations of Upper Limb Movement Information From Stroke Patients: A Qualitative Study With Simulated Information. JMIR Rehabilitation and Assistive Technologies 3, 2 (Oct. 2016), e9. https://doi.org/10.2196/rehab.6182
- A mobile software for health professionals to monitor remote patients. Ninth International Conference on Wireless and Optical Communications Networks (WOCN) (Sept. 2012), 1–4. https://doi.org/10.1109/WOCN.2012.6335565
- Parisa Rashidi and Diane J. Cook. 2010. Mining and monitoring patterns of daily routines for assisted living in real world settings. In Proceedings of the 1st ACM International Health Informatics Symposium. ACM, Arlington Virginia USA, 336–345. https://doi.org/10.1145/1882992.1883040
- AvatAR: An Immersive Analysis Environment for Human Motion Data Combining Interactive 3D Avatars and Trajectories. In CHI Conference on Human Factors in Computing Systems. ACM, New Orleans LA USA, 1–15. https://doi.org/10.1145/3491102.3517676
- Identifying and Visualizing Relevant Deviations in Longitudinal Sensor Patterns for Care Professionals. ([n. d.]).
- Composer—Visual Cohort Analysis of Patient Outcomes. Applied Clinical Informatics 10, 02 (March 2019), 278–285. https://doi.org/10.1055/s-0039-1687862
- Design Study Methodology: Reflections from the Trenches and the Stacks. IEEE Transactions on Visualization and Computer Graphics 18, 12 (Dec. 2012), 2431–2440. https://doi.org/10.1109/TVCG.2012.213
- Color Crafting: Automating the Construction of Designer Quality Color Ramps. http://arxiv.org/abs/1908.00629
- Patient non-compliance with paper diaries. BMJ (Clinical research ed.) 324, 7347 (May 2002), 1193–1194. https://doi.org/10.1136/bmj.324.7347.1193
- Physio@Home: Exploring Visual Guidance and Feedback Techniques for Physiotherapy Exercises. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, Seoul Republic of Korea, 4123–4132. https://doi.org/10.1145/2702123.2702401
- ThreadStates: State-based Visual Analysis of Disease Progression. IEEE Transactions on Visualization and Computer Graphics 28, 1 (Jan. 2022), 238–247. https://doi.org/10.1109/TVCG.2021.3114840
- Attentive Action and Context Factorization. British Machine Vision Virtual Conference (April 2019). https://doi.org/10.48550/arXiv.1904.05410
- PointShopAR: Supporting Environmental Design Prototyping Using Point Cloud in Augmented Reality. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (2023). https://doi.org/10.1145/3544548.3580776
- International Changes in COVID-19 Clinical Trajectories Across 315 Hospitals and 6 Countries: Retrospective Cohort Study (Preprint). preprint. Journal of Medical Internet Research. https://doi.org/10.2196/preprints.31400
- Graphical Perception for Immersive Analytics. IEEE Conference on Virtual Reality and 3D User Interfaces (VR) (May 2020). https://doi.org/10.1109/VR46266.2020.00084
- Designing for Mobile and Immersive Visual Analytics in the Field. http://arxiv.org/abs/1908.00680
- Embedded Data Representations. IEEE Transactions on Visualization and Computer Graphics 23, 1 (Jan. 2017), 461–470. https://doi.org/10.1109/TVCG.2016.2598608
- Ungyeon Yang and Gerard Kim. 2002. Implementation and Evaluation of “Just Follow Me”: An Immersive, VR-Based, Motion-Training System. Presence 11 (June 2002), 304–323. https://doi.org/10.1162/105474602317473240
- Reading Bar Graphs: Effects of Extraneous Depth Cues and Graphical Context. Journal of Experimental Psychology: Applied 4 (June 1998), 119–138. https://doi.org/10.1037/1076-898X.4.2.119
- Reconstruction of Human Body Pose and Appearance Using Body-Worn IMUs and a Nearby Camera View for Collaborative Egocentric Telepresence. In 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 96–97. https://doi.org/10.1109/VRW58643.2023.00025
- IDMVis: Temporal Event Sequence Visualization for Type 1 Diabetes Treatment Decision Support. IEEE Transactions on Visualization and Computer Graphics 25, 1 (Jan. 2019), 512–522. https://doi.org/10.1109/TVCG.2018.2865076
- Iterative cohort analysis and exploration. Information Visualization 14, 4 (Oct. 2015), 289–307. https://doi.org/10.1177/1473871614526077
- Activity Analysis, Summarization, and Visualization for Indoor Human Activity Monitoring. IEEE Transactions on Circuits and Systems for Video Technology 18, 11 (Nov. 2008), 1489–1498. https://doi.org/10.1109/TCSVT.2008.2005612
- Data-driven Storytelling in Hybrid Immersive Display Environments. IEEE International Symposium on Mixed and Augmented Reality Adjunct (2023). https://doi.org/10.48550/ARXIV.2308.13015