Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Human-guided Swarms: Impedance Control-inspired Influence in Virtual Reality Environments (2402.04451v1)

Published 6 Feb 2024 in cs.RO and cs.MA

Abstract: Prior works in human-swarm interaction (HSI) have sought to guide swarm behavior towards established objectives, but may be unable to handle specific scenarios that require finer human supervision, variable autonomy, or application to large-scale swarms. In this paper, we present an approach that enables human supervisors to tune the level of swarm control, and guide a large swarm using an assistive control mechanism that does not significantly restrict emergent swarm behaviors. We develop this approach in a virtual reality (VR) environment, using the HTC Vive and Unreal Engine 4 with AirSim plugin. The novel combination of an impedance control-inspired influence mechanism and a VR test bed enables and facilitates the rapid design and test iterations to examine trade-offs between swarming behavior and macroscopic-scale human influence, while circumventing flight duration limitations associated with battery-powered small unmanned aerial system (sUAS) systems. The impedance control-inspired mechanism was tested by a human supervisor to guide a virtual swarm consisting of 16 sUAS agents. Each test involved moving the swarm's center of mass through narrow canyons, which were not feasible for a swarm to traverse autonomously. Results demonstrate that integration of the influence mechanism enabled the successful manipulation of the macro-scale behavior of the swarm towards task completion, while maintaining the innate swarming behavior.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. D. Hambling, Swarm Troopers: How Small Drones Will Conquer the World. Archangel Ink, 2015.
  2. K. Jerath and S. Brennan, “Identification of locally influential agents in self-organizing multi-agent systems,” Proceedings of the American Control Conference, vol. 2015-July, pp. 335–340, 2015.
  3. T. Kim and K. Jerath, “Congestion-aware cooperative adaptive cruise control for mitigation of self-organized traffic jams,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 7, pp. 6621–6632, 2022.
  4. T. Kim and K. Jerath, “Mitigation of self-organized traffic jams using cooperative adaptive cruise control,” in 2016 International Conference on Connected Vehicles and Expo (ICCVE), pp. 7–12, IEEE, 2016.
  5. T. McMullan, “How swarming drones will change warfare,” 2019.
  6. University of Melbourne, “Your future coworkers could be a swarm of robots,” 2019.
  7. J. Peters, “Watch DARPA test out a swarm of drones,” 2019.
  8. S. Zhang, R. Pöhlmann, T. Wiedemann, A. Dammann, H. Wymeersch, and P. A. Hoeher, “Self-aware swarm navigation in autonomous exploration missions,” Proceedings of the IEEE, vol. 108, no. 7, pp. 1168–1195, 2020.
  9. M. Scott and K. Jerath, “Multi-robot exploration and coverage: Entropy-based adaptive maps with adjacency control laws,” in 2018 Annual American Control Conference (ACC), pp. 4403–4408, 2018.
  10. E. Meriaux and K. Jerath, “Evaluation of navigation and trajectory-following capabilities of small unmanned aerial systems,” in 2022 IEEE International Symposium on Technologies for Homeland Security (HST), pp. 1–7, IEEE, 2022.
  11. A. Norton, R. Ahmadzadeh, K. Jerath, P. Robinette, J. Weitzen, T. Wickramarathne, H. Yanco, M. Choi, R. Donald, B. Donoghue, et al., “Decisive test methods handbook: Test methods for evaluating sUAS in subterranean and constrained indoor environments, version 1.1,” arXiv preprint arXiv:2211.01801, 2022.
  12. L. Barnes, M. Fields, and K. Valavanis, “Unmanned ground vehicle swarm formation control using potential fields,” tech. rep., University of South Florida, 2007.
  13. H. Haeri, K. Jerath, and J. Leachman, “Thermodynamics-Inspired Macroscopic States of Bounded Swarms,” ASME Letters in Dynamic Systems and Control, vol. 1, jan 2021.
  14. E. Tsykunov, L. Labazanova, A. Tleugazy, and D. Tsetserukou, “SwarmTouch: Tactile Interaction of Human with Impedance Controlled Swarm of Nano-Quadrotors,” in IEEE International Conference on Intelligent Robots and Systems, pp. 4204–4209, Institute of Electrical and Electronics Engineers Inc., dec 2018.
  15. I. D. Couzin N W, J. Krausew, R. Jamesz, G. D. Ruxtony, and N. R. Franksz, “Collective Memory and Spatial Sorting in Animal Groups,” J. theor. Biol, vol. 218, pp. 1–11, 2002.
  16. H. Hexmoor, B. McLaughlan, and M. Baker, “Swarm control in unmanned aerial vehicles.,” in IC-AI, pp. 911–917, 2005.
  17. N. Hogan, “Controlling Impedance at the Man/Machine Interface,” in Proceedings, 1989 International Conference on Robotics and Automation, (Scottsdale, AZ, USA), pp. 1626–1631, IEEE, 1989.
  18. N. Hogan, “Adaptive Control of Mechanical Impedance by Coactivation of Antagonist Muscles,” Tech. Rep. 8, Massachusetts Institute of Technology, 1984.
  19. N. Hogan, “Impedance control: An approach to manipulation: Part I—Theory,” Journal of dynamic systems, measurement, and control, vol. 107, no. 1, pp. 1–7, 1985.
  20. R. G. Bonitz and T. C. Hsia, “Internal force-based impedance control for cooperating manipulators,” IEEE Transactions on Robotics and Automation, vol. 12, no. 1, pp. 78–89, 1996.
  21. E. Jezierski and A. Gmerek, “Impedance controllers for electric-driven robots,” Journal of Automation, Mobile Robotics & Intelligent Systems, vol. 7, pp. 13–20, 10 2013.
  22. D. Engelbrecht, N. Steyn, and K. Djouani, “Adaptive virtual impedance control of a mobile multi-robot system,” Robotics, vol. 10, no. 1, p. 19, 2021.
  23. A. Kolling, P. Walker, N. Chakraborty, K. Sycara, and M. Lewis, “Human Interaction With Robot Swarms: A Survey,” IEEE Transactions on Human-Machine Systems, vol. 46, feb 2016.
  24. J. Nagi, A. Giusti, L. M. Gambardella, and G. A. Di Caro, “Human-swarm interaction using spatial gestures,” in IEEE International Conference on Intelligent Robots and Systems, pp. 3834–3841, Institute of Electrical and Electronics Engineers Inc., oct 2014.
  25. J. McLurkin, J. Smith, J. Frankel, D. Sotkowitz, D. Blau, and B. Schmidt, “Speaking swarmish: Human-robot interface design for large Swarms of autonomous mobile robots,” in AAAI Spring Symposium - Technical Report, vol. SS-06-07, pp. 72–75, 2006.
  26. J. Patel, Y. Xu, and C. Pinciroli, “Mixed-granularity human-swarm interaction,” in 2019 International Conference on Robotics and Automation (ICRA), pp. 1059–1065, IEEE, 2019.
  27. T. Setter, H. Kawashima, and M. Egerstedt, “Team-level properties for haptic human-swarm interactions,” in 2015 American Control Conference (ACC), pp. 453–458, IEEE, 2015.
  28. J. Meyer, A. Pinosky, T. Trzpit, E. Colgate, and T. D. Murphey, “A Game Benchmark for Real-Time Human-Swarm Control,” in 2022 IEEE 18th International Conference on Automation Science and Engineering (CASE), pp. 743–750, Aug. 2022.
  29. H. Singh, B. Campbell, S. Elsayed, A. Perry, R. Hunjet, and H. Abbass, “Modulation of Force Vectors for Effective Shepherding of a Swarm: A Bi-Objective Approach,” in 2019 IEEE Congress on Evolutionary Computation (CEC), pp. 2941–2948, June 2019.
  30. M. Macchini, L. De Matteïs, F. Schiano, and D. Floreano, “Personalized Human-Swarm Interaction Through Hand Motion,” IEEE Robotics and Automation Letters, vol. 6, pp. 8341–8348, Oct. 2021.
  31. C. Xu and H. Song, “Mixed Initiative Balance of Human-Swarm Teaming in Surveillance via Reinforcement learning,” in 2021 IEEE/AIAA 40th Digital Avionics Systems Conference (DASC), pp. 1–10, Oct. 2021.
  32. M. Desai and H. A. Yanco, “Blending human and robot inputs for sliding scale autonomy,” in ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005., pp. 537–542, IEEE, 2005.
  33. H. Haeri, C. E. Beal, and K. Jerath, “Near-optimal moving average estimation at characteristic timescales: An allan variance approach,” IEEE Control Systems Letters, vol. 5, no. 5, pp. 1531–1536, 2021.
  34. K. Jerath, A. Ray, S. Brennan, and V. V. Gayah, “Statistical mechanics-inspired framework for studying the effects of mixed traffic flows on highway congestion,” in American Control Conference 2014, pp. 5402–5407, IEEE, 2014.
  35. K. Jerath, V. V. Gayah, and N. S. Brennan, “Influential subpaces of connected vehicles in highway traffic,” Transportation Research Circular, no. E-C197, 2013.
  36. K. Jerath and J. W. Langelaan, “Simulation framework for UAS conceptual design,” in AIAA Modeling and Simulation Technologies Conference, p. 1186, 2016.
  37. M. Scott and K. Jerath, “Mission performance evaluation of low-speed small unmanned aerial systems using virtual range and stereo camera sensors,” in 2018 AIAA Information Systems-AIAA Infotech@ Aerospace, p. 1240, 2018.
  38. S. Shah, D. Dey, C. Lovett, and A. Kapoor, “Airsim: High-fidelity visual and physical simulation for autonomous vehicles,” in Field and Service Robotics, 2017.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now