Localizing Moments of Actions in Untrimmed Videos of Infants with Autism Spectrum Disorder (2404.05849v1)
Abstract: Autism Spectrum Disorder (ASD) presents significant challenges in early diagnosis and intervention, impacting children and their families. With prevalence rates rising, there is a critical need for accessible and efficient screening tools. Leveraging ML techniques, in particular Temporal Action Localization (TAL), holds promise for automating ASD screening. This paper introduces a self-attention based TAL model designed to identify ASD-related behaviors in infant videos. Unlike existing methods, our approach simplifies complex modeling and emphasizes efficiency, which is essential for practical deployment in real-world scenarios. Importantly, this work underscores the importance of developing computer vision methods capable of operating in naturilistic environments with little equipment control, addressing key challenges in ASD screening. This study is the first to conduct end-to-end temporal action localization in untrimmed videos of infants with ASD, offering promising avenues for early intervention and support. We report baseline results of behavior detection using our TAL model. We achieve 70% accuracy for look face, 79% accuracy for look object, 72% for smile and 65% for vocalization.
- “Data & statistics on autism spectrum disorder,” Centers for Disease Control and Prevention, 2020.
- “Brief report: When large becomes slow: Zooming-out visual attention is associated to orienting deficits in autism,” Journal of autism and developmental disorders, vol. 48, no. 7, pp. 2577–2584, 2018.
- “Early intervention for children with autism spectrum disorder under 3 years of age: recommendations for practice and research,” Pediatrics, vol. 136, no. Supplement_1, pp. S60–S81, 2015.
- “A prospective study of the emergence of early behavioral signs of autism,” Journal of the American Academy of Child & Adolescent Psychiatry, vol. 49, no. 3, pp. 256–266, 2010.
- “Artificial neural network for diagnose autism spectrum disorder,” International Journal of Academic Information Systems Research (IJAISR), vol. 3, no. 2, 2019.
- “Asdface: Face-based autism diagnosis via heterogeneous domain adaptation,” in Proceedings of the 31st ACM International Conference on Information & Knowledge Management, 2022, pp. 4999–5003.
- “Identification of autism spectrum disorder using deep learning and the abide dataset,” NeuroImage: Clinical, vol. 17, pp. 16–23, 2018.
- “Computer vision and behavioral phenotyping: an autism case study,” Current Opinion in Biomedical Engineering, vol. 9, pp. 14–20, 2019.
- “Machine learning based autism spectrum disorder detection from videos,” in 2020 IEEE International Conference on E-health Networking, Application & Services (HEALTHCOM). IEEE, 2021, pp. 1–6.
- “Thumos challenge: Action recognition with a large number of classes,” 2014.
- “Activitynet: A large-scale video benchmark for human activity understanding,” in Proceedings of the ieee conference on computer vision and pattern recognition, 2015, pp. 961–970.
- “Actionformer: Localizing moments of actions with transformers,” in Computer Vision–ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part IV. Springer, 2022, pp. 492–510.
- “G-tad: Sub-graph localization for temporal action detection,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 10156–10165.
- “End-to-end temporal action detection with transformer,” IEEE Transactions on Image Processing, vol. 31, pp. 5427–5441, 2022.
- “Opportunities and challenges in developing deep learning models using electronic health records data: a systematic review,” Journal of the American Medical Informatics Association, vol. 25, no. 10, pp. 1419–1428, 2018.
- “Computer vision analysis for quantification of autism risk behaviors,” IEEE Transactions on Affective Computing, 2018.
- “A facial affect analysis system for autism spectrum disorder,” in 2019 IEEE International Conference on Image Processing (ICIP). IEEE, 2019, pp. 4549–4553.
- “Classifying asd children with lstm based on raw videos,” Neurocomputing, vol. 390, pp. 226–238, 2020.
- “Action recognition in video sequences using deep bi-directional lstm with cnn features,” IEEE access, vol. 6, pp. 1155–1166, 2017.
- “Soft-nms–improving object detection with one line of code,” in Proceedings of the IEEE international conference on computer vision, 2017, pp. 5561–5569.
- “Attention is all you need,” Advances in neural information processing systems, vol. 30, 2017.
- “Focal loss for dense object detection,” in Proceedings of the IEEE international conference on computer vision, 2017, pp. 2980–2988.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.