HSVRS: A Virtual Reality System of the Hide-and-Seek Game to Enhance Gaze Fixation Ability for Autistic Children (2310.13482v1)
Abstract: Numerous children diagnosed with Autism Spectrum Disorder (ASD) exhibit abnormal eye gaze pattern in communication and social interaction. Due to the high cost of ASD interventions and a shortage of professional therapists, researchers have explored the use of virtual reality (VR) systems as a supplementary intervention for autistic children. This paper presents the design of a novel VR-based system called the Hide and Seek Virtual Reality System (HSVRS). The HSVRS allows children with ASD to enhance their ocular gaze abilities while engaging in a hide-and-seek game with a virtual avatar. By employing face and voice manipulation technology, the HSVRS provides the option to customize the appearance and voice of the avatar, making it resemble someone familiar to the child, such as their parents. We conducted a pilot study at the Third Affiliated Hospital of Sun Yat-sen University, China, to evaluate the feasibility of HSVRS as an auxiliary intervention for children with autism (N=24). Through the analysis of subjective questionnaires completed by the participants' parents and objective eye gaze data, we observed that children in the VR-assisted intervention group demonstrated better performance compared to those in the control group. Furthermore, our findings indicate that the utilization of face and voice manipulation techniques to personalize avatars in hide-and-seek games can enhance the efficiency and effectiveness of the system.
- C. Lord, M. Elsabbagh, G. Baird, and J. Veenstra-Vanderweele, “Autism spectrum disorder,” The lancet, vol. 392, no. 10146, pp. 508–520, 2018.
- A. P. Association, A. P. Association et al., “Dsm-5 task force diagnostic and statistical manual of mental disorders: Dsm-5. washington,” DC: American Psychiatric Association, 2013.
- M. J. Maenner, K. A. Shaw, A. V. Bakian, D. A. Bilder, M. S. Durkin, A. Esler, S. M. Furnier, L. Hallas, J. Hall-Lande, A. Hudson et al., “Prevalence and characteristics of autism spectrum disorder among children aged 8 years—autism and developmental disabilities monitoring network, 11 sites, united states, 2018,” MMWR Surveillance Summaries, vol. 70, no. 11, p. 1, 2021.
- S. J. Webb, E. J. Jones, J. Kelly, and G. Dawson, “The motivation for very early intervention for infants at high risk for autism spectrum disorders,” International journal of speech-language pathology, vol. 16, no. 1, pp. 36–42, 2014.
- C. Chevallier, J. Parish-Morris, A. McVey, K. M. Rump, N. J. Sasson, J. D. Herrington, and R. T. Schultz, “Measuring social attention and motivation in autism spectrum disorder using eye-tracking: Stimulus type matters,” Autism Research, vol. 8, no. 5, pp. 620–628, 2015.
- W. Jones and A. Klin, “Attention to eyes is present but in decline in 2–6-month-old infants later diagnosed with autism,” Nature, vol. 504, no. 7480, pp. 427–431, 2013.
- T. W. Frazier, M. Strauss, E. W. Klingemier, E. E. Zetzer, A. Y. Hardan, C. Eng, and E. A. Youngstrom, “A meta-analysis of gaze differences to social and nonsocial information between individuals with and without autism,” Journal of the American Academy of Child & Adolescent Psychiatry, vol. 56, no. 7, pp. 546–555, 2017.
- P. O. Towle, P. A. Patrick, T. Ridgard, S. Pham, and J. Marrus, “Is earlier better? the relationship between age when starting early intervention and outcomes for children with autism spectrum disorder: a selective review,” Autism Research and Treatment, vol. 2020, 2020.
- M. M. Smith and I. Connolly, “Roles of aided communication: Perspectives of adults who use aac,” Disability and rehabilitation: Assistive technology, vol. 3, no. 5, pp. 260–273, 2008.
- S. Parsons and S. Cobb, “State-of-the-art of virtual reality technologies for children on the autism spectrum,” European Journal of Special Needs Education, vol. 26, no. 3, pp. 355–366, 2011.
- G. Little, L. Bonnar, S. Kelly, K. S. Lohan, and G. Rajendran, “Gaze contingent joint attention with an avatar in children with and without asd,” in 2016 joint IEEE international conference on development and learning and epigenetic robotics (ICDL-EpiRob). IEEE, 2016, pp. 15–20.
- N. Caruana, H. Stieglitz Ham, J. Brock, A. Woolgar, N. Kloth, R. Palermo, and G. McArthur, “Joint attention difficulties in autistic adults: an interactive eye-tracking study,” Autism, vol. 22, no. 4, pp. 502–512, 2018.
- M. Courgeon, G. Rautureau, J.-C. Martin, and O. Grynszpan, “Joint attention simulation using eye-tracking and virtual humans,” IEEE Transactions on Affective Computing, vol. 5, no. 3, pp. 238–250, 2014.
- V. Yaneva, S. Eraslan, Y. Yesilada, R. Mitkov et al., “Detecting high-functioning autism in adults using eye tracking and machine learning,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 28, no. 6, pp. 1254–1261, 2020.
- J. O. Cooper, T. E. Heron, W. L. Heward et al., “Applied behavior analysis,” 2007.
- G. Dawson, S. Rogers, J. Munson, M. Smith, J. Winter, J. Greenson, A. Donaldson, and J. Varley, “Randomized, controlled trial of an intervention for toddlers with autism: the early start denver model,” Pediatrics, vol. 125, no. 1, pp. e17–e23, 2010.
- S. Bekteshi, M. Konings, I. Vanmechelen, J. Deklerck, E. Ortibus, J.-M. Aerts, H. Hallez, P. Karlsson, B. Dan, and E. Monbaliu, “Eye gaze gaming intervention in children with dyskinetic cerebral palsy: a pilot study of task performance and its relation with dystonia and choreoathetosis,” Developmental neurorehabilitation, vol. 23, no. 8, pp. 548–556, 2020.
- S. Carlon, M. Carter, and J. Stephenson, “A review of declared factors identified by parents of children with autism spectrum disorders (asd) in making intervention decisions,” Research in Autism Spectrum Disorders, vol. 7, no. 2, pp. 369–381, 2013.
- F. Berton, L. Hoyet, A.-H. Olivier, J. Bruneau, O. Le Meur, and J. Pettré, “Eye-gaze activity in crowds: impact of virtual reality and density,” in 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 2020, pp. 322–331.
- F. Berton, A.-H. Olivier, J. Bruneau, L. Hoyet, and J. Pettré, “Studying gaze behaviour during collision avoidance with a virtual walker: Influence of the virtual reality setup,” in 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 2019, pp. 717–725.
- J. Guo, X. Zhu, Y. Yang, F. Yang, Z. Lei, and S. Z. Li, “Towards fast, accurate and stable 3d dense face alignment,” in Proceedings of the European Conference on Computer Vision (ECCV), 2020, pp. 152–168.
- X. Zhu, Z. Lei, X. Liu, H. Shi, and S. Z. Li, “Face alignment across large poses: A 3d solution,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society, 2016, pp. 146–155.
- X. Zhu, X. Liu, Z. Lei, and S. Z. Li, “Face alignment in full pose range: A 3d total solution,” IEEE transactions on pattern analysis and machine intelligence, vol. 41, no. 1, pp. 78–92, 2017.
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in neural information processing systems, vol. 30, 2017.
- H. Zhang, Z. Cai, X. Qin, and M. Li, “Sig-vc: A speaker information guided zero-shot voice conversion system for both human beings and machines,” in ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2022, pp. 6567–65 571.
- Z. Cai, C. Zhang, and M. Li, “From speaker verification to multispeaker speech synthesis, deep transfer with feedback constraint,” in Proc. of Interspeech, 2020, pp. 3974–3978.
- H. Du, X. Tian, L. Xie, and H. Li, “Optimizing voice conversion network with cycle consistency loss of speaker identity,” in 2021 IEEE Spoken Language Technology Workshop (SLT). IEEE, 2021, pp. 507–513.
- M. E. Libby, J. S. Weiss, S. Bancroft, and W. H. Ahearn, “A comparison of most-to-least and least-to-most prompting on the acquisition of solitary play skills,” Behavior analysis in practice, vol. 1, no. 1, pp. 37–43, 2008.
- A. S. Polick, J. E. Carr, and N. M. Hanney, “A comparison of general and descriptive praise in teaching intraverbal behavior to children with autism,” Journal of Applied Behavior Analysis, vol. 45, no. 3, pp. 593–599, 2012.
- E. H. Finke, J. M. Davis, M. Benedict, L. Goga, J. Kelly, L. Palumbo, T. Peart, and S. Waters, “Effects of a least-to-most prompting procedure on multisymbol message production in children with autism spectrum disorder who use augmentative and alternative communication,” American journal of speech-language pathology, vol. 26, no. 1, pp. 81–98, 2017.
- M. Yanardag, B. Birkan, İ. Yılmaz, F. K. Konukman, B. Ağbuğa, and L. Lieberman, “The effects of least-to-most prompting procedure in teaching basic tennis skills to children with autism,” Kinesiology, vol. 43, no. 1., pp. 44–55, 2011.
- J. V. Haxby, E. A. Hoffman, and M. I. Gobbini, “Human neural systems for face recognition and social communication,” Biological psychiatry, vol. 51, no. 1, pp. 59–67, 2002.
- M. T. Brodhead, T. S. Higbee, J. S. Pollard, J. S. Akers, and K. R. Gerencser, “The use of linked activity schedules to teach children with autism to play hide-and-seek,” Journal of applied behavior analysis, vol. 47, no. 3, pp. 645–650, 2014.
- J. A. Williams, R. L. Koegel, and A. L. Egel, “Response-reinforcer relationships and improved learning in autistic children,” Journal of Applied Behavior Analysis, vol. 14, no. 1, pp. 53–60, 1981.
- M. H. Charlop-Christy and L. K. Haymes, “Using objects of obsession as token reinforcers for children with autism,” Journal of Autism and Developmental Disorders, vol. 28, no. 3, pp. 189–198, 1998.
- R. L. Koegel, T. W. Vernon, and L. K. Koegel, “Improving social initiations in young children with autism using reinforcers with embedded social interactions,” Journal of autism and developmental disorders, vol. 39, no. 9, pp. 1240–1251, 2009.
- C. Lord, S. Risi, L. Lambrecht, E. H. Cook, B. L. Leventhal, P. C. DiLavore, A. Pickles, and M. Rutter, “The autism diagnostic observation schedule—generic: A standard measure of social and communication deficits associated with the spectrum of autism,” Journal of autism and developmental disorders, vol. 30, no. 3, pp. 205–223, 2000.
- C. Lord, T. Charman, A. Havdahl, P. Carbone, E. Anagnostou, B. Boyd, T. Carr, P. J. De Vries, C. Dissanayake, G. Divan et al., “The lancet commission on the future of care and clinical research in autism,” The Lancet, vol. 399, no. 10321, pp. 271–334, 2022.
- ——, “Adaptive behaviors and skills: An introduction,” in Adaptive Behavior Assessment System-II. Academic Press, 2008, pp. 1–20.
- S. Wallace, D. Fein, M. Rosanoff, G. Dawson, S. Hossain, L. Brennan, A. Como, and A. Shih, “A global public health strategy for autism spectrum disorders,” Autism Research, vol. 5, no. 3, pp. 211–217, 2012.
- C. Kasari and T. Smith, “Interventions in schools for children with autism spectrum disorder: Methods and recommendations,” Autism, vol. 17, no. 3, pp. 254–267, 2013.
- D. D. Deliyski, “Acoustic model and evaluation of pathological voice production,” in Third European Conference on Speech Communication and Technology, 1993.
- S. Kang, M. O’Reilly, L. Rojeski, K. Blenden, Z. Xu, T. Davis, J. Sigafoos, and G. Lancioni, “Effects of tangible and social reinforcers on skill acquisition, stereotyped behavior, and task engagement in three children with autism spectrum disorders,” Research in developmental disabilities, vol. 34, no. 2, pp. 739–744, 2013.
- Chengyan Yu (1 paper)
- Shihuan Wang (1 paper)
- Yingying Zhang (80 papers)
- Chaoqun Cen (1 paper)
- Zhixiang you (1 paper)
- Xiaobing zou (4 papers)
- Hongzhu Deng (1 paper)
- Ming Li (789 papers)
- Dong Zhang (170 papers)