Papers
Topics
Authors
Recent
Search
2000 character limit reached

Firefighters' Perceptions on Collaboration and Interaction with Autonomous Drones: Results of a Field Trial

Published 16 May 2024 in cs.HC | (2405.10153v1)

Abstract: Applications of drones in emergency response, like firefighting, have been promoted in the past decade. As the autonomy of drones continues to improve, the ways in which they are integrated into firefighting teams and their impact on crews are changing. This demands more understanding of how firefighters perceive and interact with autonomous drones. This paper presents a drone-based system for emergency operations with which firefighters can interact through sound, lights, and a graphical user interface. We use interviews with stakeholders collected in two field trials to explore their perceptions of the interaction and collaboration with drones. Our result shows that firefighters perceived visual interaction as adequate. However, for audio instructions and interfaces, information overload emerges as an essential problem. The potential impact of drones on current work configurations may involve shifting the position of humans closer to supervisory decision-makers and changing the training structure and content.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (76)
  1. See through the fire: evaluating the augmentation of visual perception of firefighters using depth and thermal cameras. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers (UbiComp ’17). Association for Computing Machinery, New York, NY, USA, 693–696. https://doi.org/10.1145/3123024.3129269
  2. Drone Near Me: Exploring Touch-Based Human-Drone Interaction. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (Sept. 2017), 34:1–34:8. https://doi.org/10.1145/3130899
  3. The Next Generation of Human-Drone Partnerships: Co-Designing an Emergency Response System. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376825
  4. An Activity Theory Analysis of Search & Rescue Collective Sensemaking and Planning Practices. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). Association for Computing Machinery, New York, NY, USA, 1–20. https://doi.org/10.1145/3411764.3445272
  5. Drones in Firefighting: A User-Centered Design Perspective. In Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction (MobileHCI ’21). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3447526.3472030
  6. Drone Swarms in Fire Suppression Activities: A Conceptual Framework. Drones 5, 1 (March 2021), 17. https://doi.org/10.3390/drones5010017 Number: 1 Publisher: Multidisciplinary Digital Publishing Institute.
  7. Use of Fire-Extinguishing Balls for a Conceptual System of Drone-Assisted Wildfire Fighting. Drones 3, 1 (March 2019), 17. https://doi.org/10.3390/drones3010017 Number: 1 Publisher: Multidisciplinary Digital Publishing Institute.
  8. Design and Implementation of Fire Extinguishing Ball Thrower Quadcopter. In 2020 IEEE Region 10 Symposium (TENSYMP). 1404–1407. https://doi.org/10.1109/TENSYMP50017.2020.9230808 ISSN: 2642-6102.
  9. iHDI 2020: Interdisciplinary Workshop on Human-Drone Interaction. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3334480.3375149
  10. Drone Swarms in Forest Firefighting: A Local Development Case Study of Multi-Level Human-Swarm Interaction. In Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society (NordiCHI ’20). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3419249.3421239
  11. A Review and Progress of Research on Autonomous Drone in Agriculture, Delivering Items and Geographical Information Systems (GIS). In 2019 2nd World Symposium on Communication Engineering (WSCE). 205–209. https://doi.org/10.1109/WSCE49000.2019.9041004
  12. Multimodal Interaction with Multiple Co-located Drones in Search and Rescue Missions. https://doi.org/10.48550/arXiv.1605.07316 arXiv:1605.07316 [cs].
  13. Drone & me: an exploration into natural human-drone interaction. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ’15). Association for Computing Machinery, New York, NY, USA, 361–365. https://doi.org/10.1145/2750858.2805823
  14. Spiders in the Sky: User Perceptions of Drones, Privacy, and Security. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). Association for Computing Machinery, New York, NY, USA, 6765–6776. https://doi.org/10.1145/3025453.3025632
  15. Designing a LoRa-based Smart Helmet to Aid in Emergency Detection by Monitoring Bio-signals. In 2021 IEEE Global Humanitarian Technology Conference (GHTC). 72–75. https://doi.org/10.1109/GHTC53159.2021.9612483 ISSN: 2377-6919.
  16. A Multi-Lingual Speech Recognition-Based Framework to Human-Drone Interaction. Electronics 11, 12 (Jan. 2022), 1829. https://doi.org/10.3390/electronics11121829 Number: 12 Publisher: Multidisciplinary Digital Publishing Institute.
  17. B. R. Christensen. 2015. Use of UAV or remotely piloted aircraft and forward-looking infrared in forest, rural and wildland fire management: evaluation using simple economic analysis. New Zealand Journal of Forestry Science 45, 1 (Sept. 2015), 16. https://doi.org/10.1186/s40490-015-0044-9
  18. Sensor Assisted Fire Fighting. Fire Technology 46, 3 (July 2010), 719–741. https://doi.org/10.1007/s10694-008-0069-1
  19. Wizard of Oz studies — why and how. Knowledge-Based Systems 6, 4 (Dec. 1993), 258–266. https://doi.org/10.1016/0950-7051(93)90017-N
  20. Rigid structures, independent units, monitoring: organizing patterns in frontline firefighting. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’11). Association for Computing Machinery, New York, NY, USA, 1949–1958. https://doi.org/10.1145/1978942.1979225
  21. Collaboration surrounding beacon use during companion avalanche rescue. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing (CSCW ’14). Association for Computing Machinery, New York, NY, USA, 877–887. https://doi.org/10.1145/2531602.2531684
  22. Mateusz Dolata and Kiram Ben Aleya. 2022. Morphological Analysis for Design Science Research: The Case of Human-Drone Collaboration in Emergencies. In The Transdisciplinary Reach of Design Science Research (Lecture Notes in Computer Science), Andreas Drechsler, Aurona Gerber, and Alan Hevner (Eds.). Springer International Publishing, Cham, 17–29. https://doi.org/10.1007/978-3-031-06516-3_2
  23. Mateusz Dolata and Gerhard Schwabe. 2023. Moving beyond privacy and airspace safety: Guidelines for just drones in policing. Government Information Quarterly 40, 4 (Oct. 2023), 101874. https://doi.org/10.1016/j.giq.2023.101874
  24. Drone & Wo: Cultural Influences on Human-Drone Interaction Techniques. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). Association for Computing Machinery, New York, NY, USA, 6794–6799. https://doi.org/10.1145/3025453.3025755
  25. Seong-Sil Jeong Et.al. 2021. A Study on A Smart Firefighting Helmet Capable Of Video / Audio Transmission Based On The Firefighting Standard Disaster System. Turkish Journal of Computer and Mathematics Education (TURCOMAT) 12, 6 (April 2021), 493–497. https://doi.org/10.17762/turcomat.v12i6.1885 Number: 6.
  26. Dario Floreano and Robert J. Wood. 2015. Science, technology and the future of small autonomous drones. Nature 521, 7553 (May 2015), 460–466. https://doi.org/10.1038/nature14542 Number: 7553 Publisher: Nature Publishing Group.
  27. Graphical tools for helping firefighters in victim rescues. Assessment during a live fire training program. Safety Science 114 (April 2019), 105–113. https://doi.org/10.1016/j.ssci.2019.01.015
  28. Eyal Ginosar and Jessica R. Cauchard. 2023. At First Light: Expressive Lights in Support of Drone-Initiated Communication. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). Association for Computing Machinery, New York, NY, USA, 1–17. https://doi.org/10.1145/3544548.3581062
  29. Automatic Detection System of Deteriorated PV Modules Using Drone with Thermal Camera. Applied Sciences 10, 11 (Jan. 2020), 3802. https://doi.org/10.3390/app10113802 Number: 11 Publisher: Multidisciplinary Digital Publishing Institute.
  30. Above and Beyond: A Scoping Review of Domains and Applications for Human-Drone Interaction. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–22. https://doi.org/10.1145/3491102.3501881
  31. Public Drone: Attitude Towards Drone Capabilities in Various Contexts. In Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction (MobileHCI ’21). Association for Computing Machinery, New York, NY, USA, 1–16. https://doi.org/10.1145/3447526.3472053
  32. Challenges and Requirements in Multi-Drone Interfaces. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3544549.3585673
  33. Ubiquitous computing for firefighters: field studies and prototypes of large displays for incident command. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’04). Association for Computing Machinery, New York, NY, USA, 679–686. https://doi.org/10.1145/985692.985778
  34. Design and Deployment of an Autonomous Unmanned Ground Vehicle for Urban Firefighting Scenarios. https://doi.org/10.48550/arXiv.2107.03582 arXiv:2107.03582 [cs].
  35. Remote Communication in Wilderness Search and Rescue: Implications for the Design of Emergency Distributed-Collaboration Tools for Network-Sparse Environments. Proceedings of the ACM on Human-Computer Interaction 4, GROUP (Jan. 2020), 10:1–10:26. https://doi.org/10.1145/3375190
  36. RescueCASTR: Exploring Photos and Live Streaming to Support Contextual Awareness in the Wilderness Search and Rescue Command Post. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (April 2022), 113:1–113:32. https://doi.org/10.1145/3512960
  37. Applications for the Hovermap autonomous drone system in underground mining operations. Journal of the Southern African Institute of Mining and Metallurgy 120, 1 (Jan. 2020), 49–56. https://doi.org/10.17159/2411-9717/862/2020 Publisher: The Southern African Institute of Mining and Metallurgy.
  38. Supplying resilience through assessing diversity of responses to disruption. International Journal of Operations & Production Management 40, 3 (Jan. 2020), 271–292. https://doi.org/10.1108/IJOPM-01-2019-0006 Publisher: Emerald Publishing Limited.
  39. Analysis of the Case of Fire Fighters Casualties in the Building Collapse. Procedia Engineering 135 (Jan. 2016), 343–348. https://doi.org/10.1016/j.proeng.2016.01.140
  40. Social drone companion for the home environment: A user-centric exploration. In Proceedings of the 5th International Conference on Human Agent Interaction. 89–96.
  41. A review of critical fire event library for buildings and safety framework for smart firefighting. International Journal of Disaster Risk Reduction 83 (Dec. 2022), 103412. https://doi.org/10.1016/j.ijdrr.2022.103412
  42. Md. Nafiz Hasan Khan and Carman Neustaedter. 2019. An Exploratory Study of the Use of Drones for Assisting Firefighters During Emergency Situations. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3290605.3300502
  43. Droning on About Drones—Acceptance of and Perceived Barriers to Drones in Civil Usage Contexts. In Advances in Human Factors in Robots and Unmanned Systems (Advances in Intelligent Systems and Computing), Pamela Savage-Knepshield and Jessie Chen (Eds.). Springer International Publishing, Cham, 317–329. https://doi.org/10.1007/978-3-319-41959-6_26
  44. Challenges in Autonomous UAV Cinematography: An Overview. In 2018 IEEE International Conference on Multimedia and Expo (ICME). 1–6. https://doi.org/10.1109/ICME.2018.8486586 ISSN: 1945-788X.
  45. Drones for Search and Rescue. In 1st International Workshop on Human-Drone Interaction. Ecole Nationale de l’Aviation Civile [ENAC], Glasgow, United Kingdom. https://hal.science/hal-02128385
  46. Human-Drone Interaction: Using Pointing Gesture to Define a Target Object. In Human-Computer Interaction. Multimodal and Natural Interaction (Lecture Notes in Computer Science), Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 688–705. https://doi.org/10.1007/978-3-030-49062-1_48
  47. Eleonora Mencarini and Tommaso Zambon. 2023. Becoming a Speleologist: Design Implications for Coordination in Wild Outdoor Environments. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3544548.3581545
  48. Role of Drone Technology Helping in Alleviating the COVID-19 Pandemic. Micromachines 13, 10 (Oct. 2022), 1593. https://doi.org/10.3390/mi13101593 Number: 10 Publisher: Multidisciplinary Digital Publishing Institute.
  49. Mobile computing in urban emergency situations: Improving the support to firefighters in the field. Expert Systems with Applications 38, 2 (Feb. 2011), 1255–1267. https://doi.org/10.1016/j.eswa.2010.05.018
  50. Kenzo Nonami. 2020. Present state and future prospect of autonomous control technology for industrial drones. IEEJ Transactions on Electrical and Electronic Engineering 15, 1 (2020), 6–11. https://doi.org/10.1002/tee.23041 _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/tee.23041.
  51. “I Am the Eye in the Sky – Can You Read My Mind?” How to Address Public Concerns Towards Drone Use. In Persuasive Technology: Development of Persuasive and Behavior Change Support Systems (Lecture Notes in Computer Science), Harri Oinas-Kukkonen, Khin Than Win, Evangelos Karapanos, Pasi Karppinen, and Eleni Kyza (Eds.). Springer International Publishing, Cham, 103–114. https://doi.org/10.1007/978-3-030-17287-9_9
  52. Suchi Oza and Monideepa Tarafdar. 2021. Synchronous or Asynchronous? Investigating the Impact of Online Learning Overload on Student Outcomes. SIGHCI 2021 Proceedings 14 (Dec. 2021). https://aisel.aisnet.org/sighci2021/14
  53. A Survey On Autonomous Military Service Robot. In 2020 International Conference on Emerging Trends in Information Technology and Engineering (ic-ETITE). 1–7. https://doi.org/10.1109/ic-ETITE47903.2020.78
  54. Michael Pelosi and Michael Scott Brown. 2017. Improved search paths for camera-equipped UAVS in wilderness search and rescue. In 2017 IEEE Symposium Series on Computational Intelligence (SSCI). 1–8. https://doi.org/10.1109/SSCI.2017.8280972
  55. A Drone by Any Other Name: Purposes, End-User Trustworthiness, and Framing, but Not Terminology, Affect Public Support for Drones. IEEE Technology and Society Magazine 37, 1 (March 2018), 80–91. https://doi.org/10.1109/MTS.2018.2795121 Conference Name: IEEE Technology and Society Magazine.
  56. A Survey on Robotic Technologies for Forest Firefighting: Applying Drone Swarms to Improve Firefighters’ Efficiency and Safety. Applied Sciences 11, 1 (Jan. 2021), 363. https://doi.org/10.3390/app11010363 Number: 1 Publisher: Multidisciplinary Digital Publishing Institute.
  57. Adaptive Assistance for Brain-Computer Interfaces by Online Prediction of Command Reliability. IEEE Computational Intelligence Magazine 11, 1 (2016), 32–39. https://doi.org/10.1109/MCI.2015.2501550 Num Pages: 8 Place: Piscataway Publisher: Institute of Electrical and Electronics Engineers.
  58. Johnny Saldana. 2021. The Coding Manual for Qualitative Researchers. SAGE. Google-Books-ID: RwcVEAAAQBAJ.
  59. Mohammad Fattahi Sani and Ghader Karimian. 2017. Automatic navigation and landing of an indoor AR. drone quadrotor using ArUco marker and inertial sensors. In 2017 International Conference on Computer and Drone Applications (IConDA). 102–107. https://doi.org/10.1109/ICONDA.2017.8270408
  60. BARI: An Affordable Brain-Augmented Reality Interface to Support Human–Robot Collaboration in Assembly Tasks. Information 13, 10 (Oct. 2022), 460. https://doi.org/10.3390/info13100460 Number: 10 Publisher: Multidisciplinary Digital Publishing Institute.
  61. New Vistas for Firefighter Information Systems? Towards a Systematic Evaluation of Emerging Technologies from a Task-Technology Fit Perspective. In 2016 49th Hawaii International Conference on System Sciences (HICSS). 178–187. https://doi.org/10.1109/HICSS.2016.30 ISSN: 1530-1605.
  62. Forest Fire Fighting Using Heterogeneous Ensemble of Unmanned Aerial Vehicles. In 2019 IEEE 5th International Conference Actual Problems of Unmanned Aerial Vehicles Developments (APUAVD). 218–223. https://doi.org/10.1109/APUAVD47061.2019.8943826
  63. Denise L. Smith. 2011. Firefighter Fitness: Improving Performance and Preventing Injuries and Fatalities. Current Sports Medicine Reports 10, 3 (June 2011), 167. https://doi.org/10.1249/JSR.0b013e31821a9fec
  64. Misinformation, Crisis, and Public Health—Reviewing the Literature – MediaWell. https://mediawell.ssrc.org/research-reviews/misinformation-crisis-and-public-health/
  65. Robert A. Stebbins. 2001. Exploratory research in the social sciences. Vol. 48. Sage.
  66. Dante Tezza and Marvin Andujar. 2019. The State-of-the-Art of Human–Drone Interaction: A Survey. IEEE Access 7 (2019), 167438–167454. https://doi.org/10.1109/ACCESS.2019.2953900 Conference Name: IEEE Access.
  67. Capable but Amoral? Comparing AI and Human Expert Collaboration in Ethical Decision Making. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–17. https://doi.org/10.1145/3491102.3517732
  68. Empowering public service workers to face bystander conflict: Enhancing resources through a training intervention. Journal of Occupational and Organizational Psychology 91, 1 (2018), 84–109. https://doi.org/10.1111/joop.12190 _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/joop.12190.
  69. When bystanders become bothersome: The negative consequences of bystander conflict and the moderating role of resilience. European Journal of Work and Organizational Psychology 24, 3 (May 2015), 402–419. https://doi.org/10.1080/1359432X.2014.904290 Publisher: Routledge _eprint: https://doi.org/10.1080/1359432X.2014.904290.
  70. Karl E. Weick. 1993. The Collapse of Sensemaking in Organizations: The Mann Gulch Disaster. Administrative Science Quarterly 38, 4 (1993), 628–652. https://doi.org/10.2307/2393339 Publisher: [Sage Publications, Inc., Johnson Graduate School of Management, Cornell University].
  71. Is the Frontier Shifting into the Right Direction? A Qualitative Analysis of Acceptance Factors for Novel Firefighter Information Technologies. Information Systems Frontiers 20, 4 (Aug. 2018), 669–692. https://doi.org/10.1007/s10796-017-9785-8
  72. Daniyar Wolf and Anastasia Iskhakova. 2022. Brain-Computer Interface Based on Operator Blinks to Control the Drone. In 2022 15th International Conference Management of large-scale system development (MLSD). 1–5. https://doi.org/10.1109/MLSD55143.2022.9934452
  73. Auto charging platform and algorithms for long-distance flight of drones. In 2017 IEEE International Conference on Consumer Electronics (ICCE). 186–187. https://doi.org/10.1109/ICCE.2017.7889280 ISSN: 2158-4001.
  74. Robin Yadav. 2020. Deep Learning Based Fire Recognition for Wildfire Drone Automation. Can. Sci. Fair J. 3, 2 (2020), 1–8.
  75. Evaluating the effectiveness of drones in emergency situations: a hybrid multi-criteria approach. Industrial Management & Data Systems 123, 1 (Jan. 2021), 302–323. https://doi.org/10.1108/IMDS-01-2021-0064 Publisher: Emerald Publishing Limited.
  76. Design and Research of an Articulated Tracked Firefighting Robot. Sensors 22, 14 (Jan. 2022), 5086. https://doi.org/10.3390/s22145086 Number: 14 Publisher: Multidisciplinary Digital Publishing Institute.
Citations (1)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.

Sign Up for Free