Swarm Body: Embodied Swarm Robots (2402.15830v2)
Abstract: The human brain's plasticity allows for the integration of artificial body parts into the human body. Leveraging this, embodied systems realize intuitive interactions with the environment. We introduce a novel concept: embodied swarm robots. Swarm robots constitute a collective of robots working in harmony to achieve a common objective, in our case, serving as functional body parts. Embodied swarm robots can dynamically alter their shape, density, and the correspondences between body parts and individual robots. We contribute an investigation of the influence on embodiment of swarm robot-specific factors derived from these characteristics, focusing on a hand. Our paper is the first to examine these factors through virtual reality (VR) and real-world robot studies to provide essential design considerations and applications of embodied swarm robots. Through quantitative and qualitative analysis, we identified a system configuration to achieve the embodiment of swarm robots.
- Multi-Robot System for Artistic Pattern Formation. In 2011 IEEE International Conference on Robotics and Automation. 4512–4517. https://doi.org/10.1109/ICRA.2011.5980269
- Embodiment of Supernumerary Robotic Limbs in Virtual Reality. Scientific Reports 12, 1 (June 2022), 9769. https://doi.org/10.1038/s41598-022-13981-w
- The Role of Interaction in Virtual Embodiment: Effects of the Virtual Hand Representation. In 2016 IEEE Virtual Reality (VR). 3–10. https://doi.org/10.1109/VR.2016.7504682
- Non-Human Looking Robot Arms Induce Illusion of Embodiment. International Journal of Social Robotics 9, 4 (Sept. 2017), 479–490. https://doi.org/10.1007/s12369-017-0397-8
- Matthew Botvinick and Jonathan Cohen. 1998. Rubber Hands ‘Feel’ Touch That Eyes See. Nature 391, 6669 (Feb. 1998), 756–756. https://doi.org/10.1038/35784
- Bryan Buchholz and Thomas J. Armstrong. 1991. An Ellipsoidal Representation of Human Hand Anthropometry. Human Factors 33, 4 (Aug. 1991), 429–441. https://doi.org/10.1177/001872089103300405
- Assignment Problems: Revised Reprint. Society for Industrial and Applied Mathematics. https://doi.org/10.1137/1.9781611972238
- Rovables: Miniature On-Body Robots as Mobile Wearables. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST ’16). Association for Computing Machinery, New York, NY, USA, 111–120. https://doi.org/10.1145/2984511.2984531
- An Aligned Rank Transform Procedure for Multifactor Contrast Tests. In The 34th Annual ACM Symposium on User Interface Software and Technology (UIST ’21). Association for Computing Machinery, New York, NY, USA, 754–768. https://doi.org/10.1145/3472749.3474784
- Curlybot: Designing a New Class of Computational Toys. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’00). Association for Computing Machinery, New York, NY, USA, 129–136. https://doi.org/10.1145/332040.332416
- Virtual Co-Embodiment: Evaluation of the Sense of Agency While Sharing the Control of a Virtual Body Among Two Individuals. IEEE Transactions on Visualization and Computer Graphics 27, 10 (Oct. 2021), 4023–4038. https://doi.org/10.1109/TVCG.2020.2999197
- Shaun Gallagher. 2000. Philosophical Conceptions of the Self: Implications for Cognitive Science. Trends in Cognitive Sciences 4, 1 (Jan. 2000), 14–21. https://doi.org/10.1016/S1364-6613(99)01417-5
- Individuals Prioritize the Reach Straightness and Hand Jerk of a Shared Avatar over Their Own. iScience 23, 12 (Dec. 2020), 101732. https://doi.org/10.1016/j.isci.2020.101732
- Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Advances in Psychology, Peter A. Hancock and Najmedin Meshkati (Eds.). Human Mental Workload, Vol. 52. North-Holland, 139–183. https://doi.org/10.1016/S0166-4115(08)62386-9
- Phygital Field: An Integrated Field with Physical Robots and Digital Images Using Projection-Based Localization and Control Method. SICE Journal of Control, Measurement, and System Integration 11, 4 (2018), 302–311. https://doi.org/10.9746/jcmsi.11.302
- NavigaTorch: Projection-Based Robot Control Interface Using High-Speed Handheld Projector. In SIGGRAPH Asia 2019 Emerging Technologies (Brisbane, QLD, Australia) (SA ’19). Association for Computing Machinery, New York, NY, USA, 31–33. https://doi.org/10.1145/3355049.3360538
- Projection-based localization and control method of robot swarms for swarm user interfaces. In Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 584–589. https://doi.org/10.1145/3267305.3267307
- Robotic Hand Illusion with Tactile Feedback: Unravelling the Relative Contribution of Visuotactile and Visuomotor Input to the Representation of Body Parts in Space. PLOS ONE 14, 1 (Jan. 2019), e0210058. https://doi.org/10.1371/journal.pone.0210058
- HoloBots: Augmenting Holographic Telepresence with Mobile Robots for Tangible Remote Collaboration in Mixed Reality. https://doi.org/10.1145/3586183.3606727 arXiv:2307.16114 [cs]
- Do We Have to Look at the Mirror All the Time? Effect of Partial Visuomotor Feedback on Body Ownership of a Virtual Human Tail. In ACM Symposium on Applied Perception 2019 (SAP ’19). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3343036.3343139
- Sketched Reality: Sketching Bi-Directional Interactions Between Virtual and Physical Worlds with AR and Actuated Tangible UI. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST ’22). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3526113.3545626
- Andreas Kalckert and H. Henrik Ehrsson. 2014. The Spatial Distance Rule in the Moving and Classical Rubber Hand Illusions. Consciousness and Cognition 30 (Nov. 2014), 118–132. https://doi.org/10.1016/j.concog.2014.08.022
- Interacting with Multi-Robot Systems via Mixed Reality. In 2023 IEEE International Conference on Robotics and Automation (ICRA). 11633–11639. https://doi.org/10.1109/ICRA48891.2023.10161412
- Robotic Hand Augmentation Drives Changes in Neural Body Representation. Science Robotics 6, 54 (May 2021), eabd7935. https://doi.org/10.1126/scirobotics.abd7935
- User-Defined Swarm Robot Control. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376814
- Lawrence H. Kim and Sean Follmer. 2019. SwarmHaptics: Haptic Display with Swarm Robots. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300918
- Scrambled Body: A Method to Compare Full Body Illusion and Illusory Body Ownership of Body Parts. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 1028–1029. https://doi.org/10.1109/VR.2019.8798346
- Illusory Body Ownership of an Invisible Body Interpolated between Virtual Hands and Feet via Visual-Motor Synchronicity. Scientific Reports 8, 1 (May 2018), 7541. https://doi.org/10.1038/s41598-018-25951-2
- Illusory Body Ownership Between Different Body Parts: Synchronization of Right Thumb and Right Arm. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 611–612. https://doi.org/10.1109/VR.2018.8446282
- Re-Association of Body Parts: Illusory Ownership of a Virtual Arm Associated With the Contralateral Real Finger by Visuo-Motor Synchrony. Frontiers in Robotics and AI 7 (2020).
- Invisible Long Arm Illusion: Illusory Body Ownership by Synchronous Movement of Hands and Feet. The Eurographics Association. https://doi.org/10.2312/egve20181310
- H. W. Kuhn. 1955. The Hungarian Method for the Assignment Problem. Naval Research Logistics Quarterly 2, 1-2 (1955), 83–97. https://doi.org/10.1002/nav.3800020109
- Collective Intelligence for 2D Push Manipulations With Mobile Robots. IEEE Robotics and Automation Letters 8, 5 (May 2023), 2820–2827. https://doi.org/10.1109/LRA.2023.3261751
- Zooids: Building Blocks for Swarm User Interfaces. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST ’16). Association for Computing Machinery, New York, NY, USA, 97–109. https://doi.org/10.1145/2984511.2984547
- Rolling Pixels: Robotic Steinmetz Solids for Creating Physical Animations. In Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’20). Association for Computing Machinery, New York, NY, USA, 557–564. https://doi.org/10.1145/3374920.3374987
- Sang-won Leigh and Pattie Maes. 2016. Body Integrated Programmable Joints Interface. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). Association for Computing Machinery, New York, NY, USA, 6053–6057. https://doi.org/10.1145/2858036.2858538
- Physical Telepresence: Shape Capture and Display for Embodied, Computer-Mediated Remote Collaboration. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST ’14). Association for Computing Machinery, New York, NY, USA, 461–470. https://doi.org/10.1145/2642918.2647377
- Physica: Interactive Tangible Physics Simulation Based on Tabletop Mobile Robots Towards Explorable Physics Education. In Proceedings of the 2023 ACM Designing Interactive Systems Conference (DIS ’23). Association for Computing Machinery, New York, NY, USA, 1485–1499. https://doi.org/10.1145/3563657.3596037
- Particle Robotics Based on Statistical Mechanics of Loosely Coupled Components. Nature 567, 7748 (March 2019), 361–365. https://doi.org/10.1038/s41586-019-1022-9
- ThrowIO: Actuated TUIs That Facilitate “Throwing and Catching” Spatial Interaction with Overhanging Mobile Wheeled Robots. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). Association for Computing Machinery, New York, NY, USA, 1–17. https://doi.org/10.1145/3544548.3581267
- Donna M. Lloyd. 2007. Spatial Limits on Referred Touch to an Alien Limb May Reflect Boundaries of Visuo-Tactile Peripersonal Space Surrounding the Hand. Brain and Cognition 64, 1 (June 2007), 104–109. https://doi.org/10.1016/j.bandc.2006.09.013
- Ke Ma and Bernhard Hommel. 2015. Body-Ownership for Actively Operated Non-Corporeal Objects. Consciousness and Cognition 36 (Nov. 2015), 75–86. https://doi.org/10.1016/j.concog.2015.06.003
- J Macqueen. [n. d.]. SOME METHODS FOR CLASSIFICATION AND ANALYSIS OF MULTIVARIATE OBSERVATIONS. MULTIVARIATE OBSERVATIONS ([n. d.]).
- MultiSoma: Distributed Embodiment with Synchronized Behavior and Perception. In Proceedings of the Augmented Humans International Conference 2021 (AHs ’21). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3458709.3458878
- HERMITS: Dynamically Reconfiguring the Interactivity of Self-propelled TUIs with Mechanical Shell Add-ons. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST ’20). Association for Computing Machinery, New York, NY, USA, 882–896. https://doi.org/10.1145/3379337.3415831
- (Dis)Appearables: A Concept and Method for Actuated Tangible UIs to Appear and Disappear Based on Stages. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3491102.3501906
- HandMorph: A Passive Exoskeleton That Miniaturizes Grasp. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 565–578. https://doi.org/10.1145/3379337.3415875
- The Actuated Workbench: Computer-Controlled Actuation in Tabletop Tangible Interfaces. In Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology (UIST ’02). Association for Computing Machinery, New York, NY, USA, 181–190. https://doi.org/10.1145/571985.572011
- Esben Warming Pedersen and Kasper Hornbæk. 2011. Tangible Bots: Interaction with Active Tangibles in Tabletop Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 2975–2984. https://doi.org/10.1145/1978942.1979384
- Is My Hand Connected to My Body? The Impact of Body Continuity and Arm Alignment on the Virtual Hand Illusion. Cognitive Neurodynamics 6, 4 (Aug. 2012), 295–305. https://doi.org/10.1007/s11571-011-9178-5
- The Sixth-Finger: A Modular Extra-Finger to Enhance Human Hand Capabilities. In The 23rd IEEE International Symposium on Robot and Human Interactive Communication. 993–998. https://doi.org/10.1109/ROMAN.2014.6926382
- Remote Active Tangible Interactions. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (Baton Rouge, Louisiana) (TEI ’07). Association for Computing Machinery, New York, NY, USA, 39–42. https://doi.org/10.1145/1226969.1226977
- The Robot Hand Illusion: Inducing Proprioceptive Drift through Visuo-Motor Congruency. Neuropsychologia 70 (April 2015), 414–420. https://doi.org/10.1016/j.neuropsychologia.2014.10.033
- Physical objects as bidirectional user interface elements. IEEE Computer Graphics and Applications 24, 1 (2004), 44–49. https://doi.org/10.1109/MCG.2004.1255808
- Daniel Roth and Marc Erich Latoschik. 2020. Construction of the Virtual Embodiment Questionnaire (VEQ). IEEE Transactions on Visualization and Computer Graphics 26, 12 (Dec. 2020), 3546–3556. https://doi.org/10.1109/TVCG.2020.3023603
- Virtual Region Based Multi-robot Path Planning in an Unknown Occluded Environment. In 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 588–595. https://doi.org/10.1109/IROS40897.2019.8968177
- Virtual Hand Illusion Induced by Visuomotor Correlations. PLOS ONE 5, 4 (April 2010), e10381. https://doi.org/10.1371/journal.pone.0010381
- MetaLimbs: Multiple Arms Interaction Metamorphism. In ACM SIGGRAPH 2017 Emerging Technologies (SIGGRAPH ’17). Association for Computing Machinery, New York, NY, USA, 1–2. https://doi.org/10.1145/3084822.3084837
- Atsushi Sato and Asako Yasuda. 2005. Illusion of Sense of Self-Agency: Discrepancy between the Predicted and Actual Sensory Consequences of Actions Modulates the Sense of Self-Agency, but Not the Sense of Self-Ownership. Cognition 94, 3 (Jan. 2005), 241–255. https://doi.org/10.1016/j.cognition.2004.04.003
- Swarm Robotic Behaviors and Current Applications. Frontiers in Robotics and AI 7 (2020).
- Playing the Piano with a Robotic Third Thumb: Assessing Constraints of Human Augmentation. Scientific Reports 11, 1 (Nov. 2021), 21375. https://doi.org/10.1038/s41598-021-00376-6
- The Relationship Between the Virtual Hand Illusion and Motor Performance. Frontiers in Psychology 9 (2018).
- Rubber Hand Illusion under Delayed Visual Feedback. PLOS ONE 4, 7 (July 2009), e6185. https://doi.org/10.1371/journal.pone.0006185
- Smooth and Collision-Free Navigation for Multiple Robots under Differential-Drive Constraints. In 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, Taipei, 4584–4589. https://doi.org/10.1109/IROS.2010.5652073
- RoboTable2: A Novel Programming Environment Using Physical Robots on a Tabletop Platform. In Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology (Lisbon, Portugal) (ACE ’11). Association for Computing Machinery, New York, NY, USA, Article 10, 8 pages. https://doi.org/10.1145/2071423.2071436
- HapticBots: Distributed Encountered-type Haptics for VR with Multiple Shape-changing Mobile Robots. In The 34th Annual ACM Symposium on User Interface Software and Technology (UIST ’21). Association for Computing Machinery, New York, NY, USA, 1269–1281. https://doi.org/10.1145/3472749.3474821
- ShapeBots: Shape-changing Swarm Robots. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST ’19). Association for Computing Machinery, New York, NY, USA, 493–505. https://doi.org/10.1145/3332165.3347911
- Parallel Ping-Pong: Exploring Parallel Embodiment through Multiple Bodies by a Single User. In Proceedings of the Augmented Humans International Conference 2022 (AHs ’22). Association for Computing Machinery, New York, NY, USA, 121–130. https://doi.org/10.1145/3519391.3519408
- Dynamic Shared Limbs: An Adaptive Shared Body Control Method Using EMG Sensors. In Proceedings of the Augmented Humans International Conference 2021 (AHs ’21). Association for Computing Machinery, New York, NY, USA, 10–18. https://doi.org/10.1145/3458709.3458932
- Mere Observation of Body Discontinuity Affects Perceived Ownership and Vicarious Agency over a Virtual Hand. Experimental Brain Research 233, 4 (April 2015), 1247–1259. https://doi.org/10.1007/s00221-015-4202-3
- Bodily Ownership of an Independent Supernumerary Limb: An Exploratory Study. Scientific Reports 12, 1 (Feb. 2022), 2339. https://doi.org/10.1038/s41598-022-06040-x
- Loes C. J. van Dam and Joey R. Stephens. 2018. Effects of Prolonged Exposure to Feedback Delay on the Qualitative Subjective Experience of Virtual Reality. PLOS ONE 13, 10 (Oct. 2018), e0205145. https://doi.org/10.1371/journal.pone.0205145
- Reciprocal Velocity Obstacles for Real-Time Multi-Agent Navigation. In 2008 IEEE International Conference on Robotics and Automation. 1928–1935. https://doi.org/10.1109/ROBOT.2008.4543489
- The Impact of Avatar Appearance, Perspective and Context on Gait Variability and User Experience in Virtual Reality. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 326–335. https://doi.org/10.1109/VR50410.2021.00055
- The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’11). Association for Computing Machinery, New York, NY, USA, 143–146. https://doi.org/10.1145/1978942.1978963
- Social Digital Cyborgs: The Collaborative Design Process of JIZAI ARMS. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (¡conf-loc¿, ¡city¿Hamburg¡/city¿, ¡country¿Germany¡/country¿, ¡/conf-loc¿) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 369, 19 pages. https://doi.org/10.1145/3544548.3581169
- TOMURA: A Mountable Hand-Shaped Interface for Versatile Interactions. In Proceedings of the Augmented Humans International Conference 2023 (Glasgow, United Kingdom) (AHs ’23). Association for Computing Machinery, New York, NY, USA, 243–254. https://doi.org/10.1145/3582700.3582719
- AeroRigUI: Actuated TUIs for Spatial Interaction Using Rigging Swarm Robots on Ceilings in Everyday Space. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). Association for Computing Machinery, New York, NY, USA, 1–18. https://doi.org/10.1145/3544548.3581437
- Robotic Assembly of Haptic Proxy Objects for Tangible Interaction and Virtual Reality. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS ’17). Association for Computing Machinery, New York, NY, USA, 82–91. https://doi.org/10.1145/3132272.3134143