Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Establishing Awareness through Pointing Gestures during Collaborative Decision-Making in a Wall-Display Environment (2401.09324v1)

Published 17 Jan 2024 in cs.HC

Abstract: Sharing a physical environment, such as that of a wall-display, facilitates gaining awareness of others' actions and intentions, thereby bringing benefits for collaboration. Previous studies have provided first insights on awareness in the context of tabletops or smaller vertical displays. This paper seeks to advance the current understanding on how users share awareness information in wall-display environments and focusses on mid-air pointing gestures as a foundational part of communication. We present a scenario dealing with the organization of medical supply chains in crisis situations, and report on the results of a user study with 24 users, split into 6 groups of 4, performing several tasks. We investigate pointing gestures and identify three subtypes used as awareness cues during face-to-face collaboration: narrative pointing, loose pointing, and sharp pointing. Our observations show that reliance on gesture subtypes varies across participants and groups, and that sometimes vague pointing is sufficient to support verbal negotiations.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. F. Rajabiyazdi, J. Walny, C. Mah, J. Brosz, and S. Carpendale, “Understanding researchers’ use of a large, high-resolution display across disciplines,” in Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces, pp. 107–116, 2015.
  2. K. Reda, A. E. Johnson, M. E. Papka, and J. Leigh, “Effects of display size and resolution on user behavior and insight acquisition in visual exploration,” in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 2759–2768, 2015.
  3. E. Hornecker, P. Marshall, N. S. Dalton, and Y. Rogers, “Collaboration and interference: awareness with mice or touch input,” in Proceedings of the 2008 ACM conference on Computer supported cooperative work, pp. 167–176, 2008.
  4. D. Pinelle, M. Nacenta, C. Gutwin, and T. Stach, “The effects of co-present embodiments on awareness and collaboration in tabletop groupware,” in Proceedings of graphics interface 2008, pp. 1–8, 2008.
  5. D. Anastasiou, H. Afkari, and V. Maquil, ““you move this!”: Annotation of pointing gestures on tabletop interfaces in low awareness situations,” in Proceedings of LREC2020 Workshop” People in language, vision and the mind”(ONION2020), pp. 22–27, 2020.
  6. ReSurf Project. https://www.list.lu/en/research/project/resurf/. Accessed: 2023-03-06.
  7. R. Langner, U. Kister, and R. Dachselt, “Multiple coordinated views at large displays for multiple users: Empirical findings on user behavior, movements, and distances,” IEEE transactions on visualization and computer graphics, vol. 25, no. 1, pp. 608–618, 2018.
  8. C. Andrews, A. Endert, and C. North, “Space to think: large high-resolution displays for sensemaking,” in Proceedings of the SIGCHI conference on human factors in computing systems, pp. 55–64, 2010.
  9. M. Beaudouin-Lafon, S. Huot, M. Nancel, W. Mackay, E. Pietriga, R. Primet, J. Wagner, O. Chapuis, C. Pillias, J. Eagan, et al., “Multisurface interaction in the wild room,” Computer, vol. 45, no. 4, pp. 48–56, 2012.
  10. M. R. Jakobsen and K. Hornbæk, “Up close and personal: Collaborative work on a high-resolution multitouch wall display,” ACM Transactions on Computer-Human Interaction (TOCHI), vol. 21, no. 2, pp. 1–34, 2014.
  11. A. Prouzeau, A. Bezerianos, and O. Chapuis, “Awareness techniques to aid transitions between personal and shared workspaces in multi-display environments,” in Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces, pp. 291–304, 2018.
  12. N. Yuill and Y. Rogers, “Mechanisms for collaboration: A design and evaluation framework for multi-user interfaces,” ACM Transactions on Computer-Human Interaction (TOCHI), vol. 19, no. 1, pp. 1–25, 2012.
  13. M. R. Endsley, “Measurement of situation awareness in dynamic systems,” Human factors, vol. 37, no. 1, pp. 65–84, 1995.
  14. P. Dourish and V. Bellotti, “Awareness and coordination in shared workspaces,” in Proceedings of the 1992 ACM conference on Computer-supported cooperative work, pp. 107–114, 1992.
  15. C. Gutwin and S. Greenberg, “A descriptive framework of workspace awareness for real-time groupware,” Computer Supported Cooperative Work (CSCW), vol. 11, pp. 411–446, 2002.
  16. J. D. Herbsleb, A. Mockus, T. A. Finholt, and R. E. Grinter, “Distance, dependencies, and delay in a global collaboration,” in Proceedings of the 2000 ACM conference on Computer supported cooperative work, pp. 319–328, 2000.
  17. G. Mark, “Conventions and commitments in distributed cscw groups,” Computer Supported Cooperative Work (CSCW), vol. 11, pp. 349–387, 2002.
  18. T. Marrinan, J. Leigh, L. Renambot, A. Forbes, S. Jones, and A. E. Johnson, “Mixed presence collaboration using scalable visualizations in heterogeneous display spaces,” in Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, pp. 2236–2245, 2017.
  19. M. Kuechler and A. M. Kunz, “Collaboard: a remote collaboration groupware device featuring an embodiment-enriched shared workspace,” in Proceedings of the 2010 ACM International Conference on Supporting Group Work, pp. 211–214, 2010.
  20. N. Yamashita, K. Kaji, H. Kuzuoka, and K. Hirata, “Improving visibility of remote gestures in distributed tabletop collaboration,” in Proceedings of the ACM 2011 conference on Computer supported cooperative work, pp. 95–104, 2011.
  21. O. Oyekoya, R. Stone, W. Steptoe, L. Alkurdi, S. Klare, A. Peer, T. Weyrich, B. Cohen, F. Tecchia, and A. Steed, “Supporting interoperability and presence awareness in collaborative mixed reality environments,” in Proceedings of the 19th ACM Symposium on Virtual Reality Software and Technology, pp. 165–174, 2013.
  22. L. Tong, A. Tabard, S. George, and A. Serna, “Horizontal vs. vertical: How the orientation of a large interactive surface impacts collaboration in multi-surface environments,” in Human-Computer Interaction–INTERACT 2017: 16th IFIP TC 13 International Conference, Mumbai, India, September 25–29, 2017, Proceedings, Part III 16, pp. 202–222, Springer, 2017.
  23. Psychology Press, 2003.
  24. A. Kendon and L. Versante, “Pointing by hand in neapolitan,” Pointing: Where language, culture, and cognition meet, pp. 109–137, 2003.
  25. D. Wilkins, “Why pointing with the index finger is not a universal (in sociocultural and semiotic terms),” Pointing: Where language, culture, and cognition meet, pp. 171–215, 2003.
  26. C. Liu, O. Chapuis, M. Beaudouin-Lafon, and E. Lecolinet, “Coreach: Cooperative gestures for data manipulation on wall-sized displays,” in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 6730–6741, 2017.
  27. L. Hespanhol, M. Tomitsch, K. Grace, A. Collins, and J. Kay, “Investigating intuitiveness and effectiveness of gestures for free spatial interaction with large displays,” in Proceedings of the 2012 International Symposium on Pervasive Displays, pp. 1–6, 2012.
  28. I. Avellino, C. Fleury, and M. Beaudouin-Lafon, “Accuracy of deictic gestures to support telepresence on wall-sized displays,” in Proceedings of the 33rd annual acm conference on human factors in computing systems, pp. 2393–2396, 2015.
  29. D. W. Johnson and R. T. Johnson, “Making cooperative learning work,” Theory into practice, vol. 38, no. 2, pp. 67–73, 1999.
  30. L. Tong, A. Serna, S. George, and A. Tabard, “Supporting decision-making activities in multi-surface learning environments,” in Proceedings of the 9th International Conference on Computer Supported Education (CSEDU 2017), vol. 1, pp. 70–81, 2017.
  31. L. Vandenabeele, H. Afkari, J. Hermen, L. Deladiennée, C. Moll, and V. Maquil, “Deborah: a web-based cross-device orchestration layer,” in Proceedings of the 2022 International Conference on Advanced Visual Interfaces, pp. 1–3, 2022.
  32. P. Wittenburg, H. Brugman, A. Russel, A. Klassmann, and H. Sloetjes, “Elan: A professional framework for multimodality research,” in 5th international conference on language resources and evaluation (LREC 2006), pp. 1556–1559, 2006.
  33. D. Anastasiou, V. Maquil, and E. Ras, “Gesture analysis in a case study with a tangible user interface for collaborative problem solving,” Journal on Multimodal User Interfaces, vol. 8, pp. 305–317, 2014.
  34. A. Banerjee, J. Burstyn, A. Girouard, and R. Vertegaal, “Pointable: an in-air pointing technique to manipulate out-of-reach targets on tabletops,” in Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, pp. 11–20, 2011.
  35. U. Hinrichs and S. Carpendale, “Gestures in the wild: studying multi-touch gesture sequences on interactive tabletop exhibits,” in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 3023–3032, 2011.
  36. N. Soni, A. Darrow, A. Luc, S. Gleaves, C. Schuman, H. Neff, P. Chang, B. Kirkland, J. Alexandre, A. Morales, et al., “Affording embodied cognition through touchscreen and above-the-surface gestures during collaborative tabletop science learning,” International Journal of Computer-Supported Collaborative Learning, vol. 16, pp. 105–144, 2021.
  37. D. K. O’Neill, “Two-year-old children’s sensitivity to a parent’s knowledge state when making requests,” Child development, vol. 67, no. 2, pp. 659–677, 1996.
  38. Y. Okuya, O. Gladin, N. Ladevèze, C. Fleury, and P. Bourdot, “Investigating collaborative exploration of design alternatives on a wall-sized display,” in Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–12, 2020.
  39. L. D. Segal, “Effects of checklist interface on non-verbal crew communications,” tech. rep., 1994.
  40. P. Ekman and W. V. Friesen, “Hand movements,” Journal of communication, vol. 22, no. 4, pp. 353–374, 1972.
  41. D. McNeill, Gesture and thought. University of Chicago press, 2005.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Valérie Maquil (4 papers)
  2. Dimitra Anastasiou (2 papers)
  3. Hoorieh Afkari (1 paper)
  4. Adrien Coppens (8 papers)
  5. Johannes Hermen (1 paper)
  6. Lou Schwartz (2 papers)
Citations (5)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now