Video-Based Autism Detection with Deep Learning (2402.16774v2)
Abstract: Individuals with Autism Spectrum Disorder (ASD) often experience challenges in health, communication, and sensory processing; therefore, early diagnosis is necessary for proper treatment and care. In this work, we consider the problem of detecting or classifying ASD children to aid medical professionals in early diagnosis. We develop a deep learning model that analyzes video clips of children reacting to sensory stimuli, with the intent of capturing key differences in reactions and behavior between ASD and non-ASD participants. Unlike many recent studies in ASD classification with MRI data, which require expensive specialized equipment, our method utilizes a powerful but relatively affordable GPU, a standard computer setup, and a video camera for inference. Results show that our model effectively generalizes and understands key differences in the distinct movements of the children. It is noteworthy that our model exhibits successful classification performance despite the limited amount of data for a deep learning problem and limited temporal information available for learning, even with the motion artifacts.
- Eye tracking-based diagnosis and early detection of autism spectrum disorder using machine learning and deep learning techniques. Electronics, 11(4), 2022.
- Shi Chen and Qi Zhao. Attention-based autism spectrum disorder screening with privileged modality. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2019.
- An image is worth 16x16 words: Transformers for image recognition at scale, 2021.
- Identifying children with autism spectrum disorder based on gaze-following. In 2020 IEEE International Conference on Image Processing (ICIP), pages 423–427, 2020.
- Ms-celeb-1m: A dataset and benchmark for large-scale face recognition, 2016.
- Ml-dsvm+: A meta-learning based deep svm+ for computer-aided diagnosis. Pattern Recognition, 134:109076, 2023.
- Deep residual learning for image recognition, 2015.
- Long short-term memory. Neural Comput., 9(8):1735–1780, nov 1997.
- Source free semi-supervised transfer learning for diagnosis of mental disorders on fmri scans. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(11):13778–13795, 2023.
- Asd-evnet: An ensemble vision network based on facial expression for autism spectrum disorder recognition. In 2023 18th International Conference on Machine Vision and Applications (MVA), pages 1–5, 2023.
- Convolutional kernels with an element-wise weighting mechanism for identifying abnormal brain connectivity patterns. Pattern Recognition, 109:107570, 2021.
- Ming Jiang and Qi Zhao. Learning visual attention to identify people with autism spectrum disorder. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), Oct 2017.
- Swin transformer: Hierarchical vision transformer using shifted windows, 2021.
- Sgdr: Stochastic gradient descent with warm restarts, 2017.
- Decoupled weight decay regularization, 2019.
- Optimal transport based pyramid graph kernel for autism spectrum disorder diagnosis. Pattern Recognition, 143:109716, 2023.
- Early detection of children with autism spectrum disorder based on visual exploration of images. Signal Processing: Image Communication, 94:116184, 2021.
- Mobilevit: Light-weight, general-purpose, and mobile-friendly vision transformer, 2022.
- Pytorch: An imperative style, high-performance deep learning library, 2019.
- Improving the detection of autism spectrum disorder by combining structural and functional mri information. NeuroImage: Clinical, 25:102181, 2020.
- Imagenet large scale visual recognition challenge, 2015.
- Automated detection of autism spectrum disorder using a convolutional neural network. Frontiers in Neuroscience, 13, 2020.
- Efficientnet: Rethinking model scaling for convolutional neural networks, 2020.
- Attention is all you need, 2023.
- Activity recognition with moving cameras and few training examples: Applications for detection of autism-related headbanging. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, CHI EA ’21, New York, NY, USA, 2021. Association for Computing Machinery.
- Detection of autism spectrum disorder using fmri functional connectivity with feature selection and deep learning. Cognitive Computation, 2023.