Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Design Frameworks for Spatial Zone Agents in XRI Metaverse Smart Environments (2401.11040v1)

Published 19 Jan 2024 in cs.HC

Abstract: The spatial XR-IoT (XRI) Zone Agents concept combines Extended Reality (XR), the Internet of Things (IoT), and spatial computing concepts to create hyper-connected spaces for metaverse applications; envisioning space as zones that are social, smart, scalable, expressive, and agent-based. These zone agents serve as applications and agents (partners, assistants, or guides) for users co-living and co-operating together in a shared spatial context. The zone agent concept is toward reducing the gap between the physical environment (space) and the classical two-dimensional user interface, through space-based interactions for future metaverse applications. This integration aims to enrich user engagement with their environments through intuitive and immersive experiences and pave the way for innovative human-machine interaction in smart spaces. Contributions include: i) a theoretical framework for creating XRI zone/space-agents using Mixed-Reality Agents (MiRAs) and XRI theory, ii) agent and scene design for spatial zone agents, and iii) prototype and user interaction design scenario concepts for human-to-space agent relationships in an early immersive smart-space application.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. L.-H. Lee, T. Braud, P. Zhou, L. Wang, D. Xu, Z. Lin, A. Kumar, C. Bermejo, and P. Hui, “All one needs to know about metaverse: A complete survey on technological singularity, virtual ecosystem, and research agenda,” arXiv preprint arXiv:2110.05352, 2021.
  2. J. Guan, J. Irizawa, and A. Morris, “Extended reality and internet of things for hyper-connected metaverse environments,” in 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2022, pp. 163–168.
  3. J. Guan, A. Morris, and J. Irizawa, “Cross-reality for extending the metaverse: Designing hyper-connected immersive environments with xri,” in 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2023, pp. 305–311.
  4. ——, “Extending the metaverse: Hyper-connected smart environments with mixed reality and the internet of things,” in 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2023, pp. 817–818.
  5. J. Guan, “Extending the metaverse: Exploring generative objects with extended reality environments and adaptive context awareness,” 2022.
  6. A. Morris, J. Guan, and A. Azhar, “An xri mixed-reality internet-of-things architectural framework toward immersive and adaptive smart environments,” in 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), 2021, pp. 68–74.
  7. T. Tsang and A. Morris, “A hybrid quality-of-experience taxonomy for mixed reality iot (xri) systems,” in 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2021, pp. 1809–1816.
  8. J. Guan and A. Morris, “Design frameworks for hyper-connected social xri immersive metaverse environments,” arXiv preprint arXiv:2306.06230, 2023.
  9. A. Resmini, B. Lindenfalk, and J. Jauhiainen, “Being elsewhere: An information architecture approach to the design of a sense of presence in xr environments,” in International Conference on Human-Computer Interaction.   Springer, 2023, pp. 502–521.
  10. R. Suzuki, A. Karim, T. Xia, H. Hedayati, and N. Marquardt, “Augmented reality and robotics: A survey and taxonomy for ar-enhanced human-robot interaction and robotic interfaces,” in Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, 2022, pp. 1–33.
  11. T. Holz, A. G. Campbell, G. M. O’Hare, J. W. Stafford, A. Martin, and M. Dragone, “Mira—mixed reality agents,” International journal of human-computer studies, vol. 69, no. 4, pp. 251–268, 2011.
  12. D. Jo and G. J. Kim, “Ariot: scalable augmented reality framework for interacting with internet of things appliances everywhere,” IEEE Transactions on Consumer Electronics, vol. 62, no. 3, pp. 334–340, 2016.
  13. ——, “Ar enabled iot for a smart and interactive environment: A survey and future directions,” Sensors, vol. 19, no. 19, p. 4330, 2019.
  14. Y. Shao, N. Lessio, and A. Morris, “Iot avatars: Mixed reality hybrid objects for core ambient intelligent environments,” Procedia Computer Science, vol. 155, pp. 433–440, 2019, the 16th International Conference on Mobile Systems and Pervasive Computing (MobiSPC 2019),The 14th International Conference on Future Networks and Communications (FNC-2019),The 9th International Conference on Sustainable Energy Information Technology. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S1877050919309743
  15. J. Guan, N. Lessio, Y. Shao, and A. Morris, “Exploring a mixed reality framework for the internet-of-things: Toward visualization and interaction with hybrid objects and avatars,” in 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2020, pp. 857–857.
  16. A. Morris, J. Guan, N. Lessio, and Y. Shao, “Toward mixed reality hybrid objects with iot avatar agents,” in 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2020, pp. 766–773.
  17. J. D. N. Dionisio, W. G. B. III, and R. Gilbert, “3d virtual worlds and the metaverse: Current status and future possibilities,” ACM Computing Surveys (CSUR), vol. 45, no. 3, pp. 1–38, 2013.
  18. H. Ning, H. Wang, Y. Lin, W. Wang, S. Dhelim, F. Farha, J. Ding, and M. Daneshmand, “A survey on metaverse: the state-of-the-art, technologies, applications, and challenges,” arXiv preprint arXiv:2111.09673, 2021.
  19. R. Cheng, N. Wu, S. Chen, and B. Han, “Will metaverse be nextg internet? vision, hype, and reality,” arXiv preprint arXiv:2201.12894, 2022.
  20. S. Shekhar, S. K. Feiner, and W. G. Aref, “Spatial computing,” Commun. ACM, vol. 59, no. 1, p. 72–81, dec 2015. [Online]. Available: https://doi.org/10.1145/2756547
  21. S. Greenwold, “Spatial computing,” Massachusetts Institute of Technology, Master, 2003.
  22. M. R. Marner, R. T. Smith, J. A. Walsh, and B. H. Thomas, “Spatial user interfaces for large-scale projector-based augmented reality,” IEEE computer graphics and applications, vol. 34, no. 6, pp. 74–82, 2014.
  23. M. Wooldridge and N. R. Jennings, “Intelligent agents: Theory and practice,” The knowledge engineering review, vol. 10, no. 2, pp. 115–152, 1995.
  24. D. Szafir, “Mediating human-robot interactions with virtual, augmented, and mixed reality,” in International Conference on Human-Computer Interaction.   Springer, 2019, pp. 124–149.
  25. N. R. Jennings, K. Sycara, and M. Wooldridge, “A roadmap of agent research and development,” Autonomous agents and multi-agent systems, vol. 1, no. 1, pp. 7–38, 1998.
  26. L. Padgham and M. Winikoff, “Prometheus: A methodology for developing intelligent agents,” in International Workshop on Agent-Oriented Software Engineering.   Springer, 2002, pp. 174–185.
  27. P. Caillou, B. Gaudou, A. Grignard, C. Q. Truong, and P. Taillandier, “A simple-to-use bdi architecture for agent-based modeling and simulation,” in Advances in Social Simulation 2015.   Springer, 2017, pp. 15–28.
  28. R. H. Bordini, A. El Fallah Seghrouchni, K. Hindriks, B. Logan, and A. Ricci, “Agent programming in the cognitive era,” Autonomous Agents and Multi-Agent Systems, vol. 34, no. 2, pp. 1–31, 2020.
  29. M. Iovino, E. Scukins, J. Styrud, P. Ögren, and C. Smith, “A survey of behavior trees in robotics and ai,” Robotics and Autonomous Systems, vol. 154, p. 104096, 2022.
  30. H. Ushida, Y. Hirayama, and H. Nakajima, “Emotion model for life-like agent and its evaluation,” in AAAI/IAAI, 1998, pp. 62–69.
  31. K. Gushima, H. Akasaki, and T. Nakajima, “Ambient bot: delivering daily casual information through eye contact with an intimate virtual creature,” in Proceedings of the 21st International Academic Mindtrek Conference, 2017, pp. 231–234.
  32. D. Bylieva, N. Almazova, V. Lobatyuk, and A. Rubtsova, “Virtual pet: trends of development,” in The 2018 International Conference on Digital Science.   Springer, 2019, pp. 545–554.
  33. B. Wang and P.-L. P. Rau, “Influence of embodiment and substrate of social robots on users’ decision-making and attitude,” International Journal of Social Robotics, vol. 11, no. 3, pp. 411–421, 2019.
  34. V. Groom, C. Nass, T. Chen, A. Nielsen, J. K. Scarborough, and E. Robles, “Evaluating the effects of behavioral realism in embodied agents,” International Journal of Human-Computer Studies, vol. 67, no. 10, pp. 842–849, 2009.
  35. A. Ramesh, M. Pavlov, G. Goh, S. Gray, C. Voss, A. Radford, M. Chen, and I. Sutskever, “Zero-shot text-to-image generation,” in International Conference on Machine Learning.   PMLR, 2021, pp. 8821–8831.
  36. K. Crowson, S. Biderman, D. Kornis, D. Stander, E. Hallahan, L. Castricato, and E. Raff, “Vqgan-clip: Open domain image generation and editing with natural language guidance,” in European Conference on Computer Vision.   Springer, 2022, pp. 88–105.
  37. P. Milgram and F. Kishino, “A taxonomy of mixed reality visual displays,” IEICE TRANSACTIONS on Information and Systems, vol. 77, no. 12, pp. 1321–1329, 1994.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)
  1. Jie Guan (30 papers)
  2. Jiamin Liu (14 papers)
  3. Alexis Morris (9 papers)
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets