Papers
Topics
Authors
Recent
2000 character limit reached

DISCERN: Designing Decision Support Interfaces to Investigate the Complexities of Workplace Social Decision-Making With Line Managers (2402.19318v1)

Published 29 Feb 2024 in cs.HC

Abstract: Line managers form the first level of management in organizations, and must make complex decisions, while maintaining relationships with those impacted by their decisions. Amidst growing interest in technology-supported decision-making at work, their needs remain understudied. Further, most existing design knowledge for supporting social decision-making comes from domains where decision-makers are more socially detached from those they decide for. We conducted iterative design research with line managers within a technology organization, investigating decision-making practices, and opportunities for technological support. Through formative research, development of a decision-representation tool -- DISCERN -- and user enactments, we identify their communication and analysis needs that lack adequate support. We found they preferred tools for externalizing reasoning rather than tools that replace interpersonal interactions, and they wanted tools to support a range of intuitive and calculative decision-making. We discuss how design of social decision-making supports, especially in the workplace, can more explicitly support highly interactional social decision-making.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (71)
  1. Farrokh Alemi and David H Gustafson. 2007. Decision analysis for healthcare managers. (No Title) (2007).
  2. Visualizing consensus in group decision making situations. In 2007 IEEE International Fuzzy Systems Conference. IEEE, 1–6.
  3. Using visualization tools to guide consensus in group decision making. In Applications of Fuzzy Sets Theory: 7th International Workshop on Fuzzy Logic and Applications, WILF 2007, Camogli, Italy, July 7-10, 2007. Proceedings 7. Springer, 77–85.
  4. Peter Blau. 2017. Exchange and power in social life. Routledge.
  5. Affect: from information to interaction. In Proceedings of the 4th decennial conference on Critical computing: between sense and sensibility. 59–68.
  6. Citizen panels and opinion polls: convergence and divergence in policy preferences. Journal of Deliberative Democracy 14, 1 (2018).
  7. AHA!: Facilitating AI Impact Assessment by Generating Examples of Harms. arXiv preprint arXiv:2306.03280 (2023).
  8. Decision theory as practice: Crafting rationality in organizations. Organization Studies 31, 11 (2010), 1531–1566.
  9. Stuart Candy and Jake Dunagan. 2017. Designing an experiential scenario: The people who vanished. Futures 86 (2017), 136–153.
  10. Giuseppe Carenini and John Loyd. 2004. Valuecharts: analyzing linear models expressing preferences and evaluations. In Proceedings of the working conference on Advanced visual interfaces. 150–157.
  11. Quan Ze Chen and Amy X Zhang. 2023. Judgment Sieve: Reducing Uncertainty in Group Judgments through Interventions Targeting Ambiguity versus Disagreement. arXiv preprint arXiv:2305.01615 (2023).
  12. A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions. In Conference on Fairness, Accountability and Transparency. PMLR, 134–148.
  13. Franck Cochoy. 2008. Calculation, qualculation, calqulation: shopping cart arithmetic, equipped cognition and the clustered consumer. Marketing theory 8, 1 (2008), 15–44.
  14. Franck Cochoy. 2014. Une sociologie du packaging ou l’âne de Buridan face au marché: Les emballages et le choix du consommateur. Puf.
  15. Kevin C Desouza and Akshay Bhagwatwar. 2017. Technology-enabled participatory platforms for civic engagement: The case of US cities. In Urban Informatics. Routledge, 25–50.
  16. Evanthia Dimara and Charles Perin. 2019. What is interaction for data visualization? IEEE transactions on visualization and computer graphics 26, 1 (2019), 119–129.
  17. The unmet data visualization needs of decision makers within organizations. IEEE Transactions on Visualization and Computer Graphics 28, 12 (2021), 4101–4112.
  18. Jac Fitz-Enz and II John Mattox. 2014. Predictive analytics for human resources. John Wiley & Sons.
  19. Design: cultural probes. interactions 6, 1 (1999), 21–29.
  20. Convolutional neural networks for toxic comment classification. In Proceedings of the 10th hellenic conference on artificial intelligence. 1–6.
  21. Jury learning: Integrating dissenting voices into machine learning models. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–19.
  22. The disagreement deconvolution: Bringing machine learning performance metrics in line with reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14.
  23. Lineup: Visual analysis of multi-attribute rankings. IEEE transactions on visualization and computer graphics 19, 12 (2013), 2277–2286.
  24. Visualizing uncertainty and alternatives in event sequence predictions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.
  25. J Richard Hackman and Robert E Kaplan. 1974. Interventions into group process: An approach to improving the effectiveness of groups. Decision Sciences 5, 3 (1974), 459–480.
  26. The three paradigms of HCI. In Alt. Chi. Session at the SIGCHI Conference on human factors in computing systems San Jose, California, USA. 1–18.
  27. Fred Hassan. 2011. The Frontline Advantage. https://hbr.org/2011/05/the-frontline-advantage
  28. Gamut: A design probe to understand how data scientists understand machine learning models. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–13.
  29. Can workplace tracking ever empower? Collective sensemaking for the responsible use of sensor data at work. Proceedings of the ACM on human-computer interaction 5, GROUP (2021), 1–21.
  30. Ronald A Howard. 1966. Decision analysis: Applied decision theory. Stanford Research Institute.
  31. Co-Designing Alternatives for the Future of Gig Worker Well-Being: Navigating Multi-Stakeholder Incentives and Preferences. In Proceedings of the 2023 ACM Designing Interactive Systems Conference. 664–687.
  32. Technology probes: inspiring design for and with families. In Proceedings of the SIGCHI conference on Human factors in computing systems. 17–24.
  33. Sohyeon Hwang and Jeremy D Foote. 2021. Why do people participate in small online communities? Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1–25.
  34. CommunityPulse: Facilitating community input analysis by surfacing hidden insights, reflections, and priorities. In Designing Interactive Systems Conference 2021. 846–863.
  35. CommunityClick: Capturing and reporting community feedback from town halls to improve inclusivity. Proceedings of the ACM on Human-Computer Interaction 4, CSCW3 (2021), 1–32.
  36. Pearl: A Technology Probe for Machine-Assisted Reflection on Personal Data. In Proceedings of the 28th International Conference on Intelligent User Interfaces. 902–918.
  37. Training towards critical use: Learning to situate ai predictions relative to human knowledge. In Proceedings of The ACM Collective Intelligence Conference. 63–78.
  38. Improving human-AI partnerships in child welfare: understanding worker practices, challenges, and desires for algorithmic decision support. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–18.
  39. “Why Do I Care What’s Similar?” Probing Challenges in AI-Assisted Child Welfare Decision-Making through Worker-AI Interface Design Concepts. In Designing Interactive Systems Conference. 454–470.
  40. Kenneth L Kraemer and John Leslie King. 1988. Computer-based systems for cooperative work and group decision making. ACM Computing Surveys (CSUR) 20, 2 (1988), 115–146.
  41. Supporting reflective public thought with considerit. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. 265–274.
  42. Making decisions from a distance: The impact of technological mediation on riskiness and dehumanization. In Proceedings of the 18th ACM Conference on computer supported cooperative work & social computing. 1576–1589.
  43. Victoria K Lee and Lasana T Harris. 2013. How social cognition can inform social decision making. Frontiers in neuroscience 7 (2013), 259.
  44. Algorithms and decision-making in the public sector. Annual Review of Law and Social Science 17 (2021), 309–334.
  45. ConsensUs: Supporting multi-criteria group decisions by visualizing points of disagreement. , 26 pages.
  46. Exploring regional futures: Lessons from Metropolitan Chicago’s online MetroQuest. Technological Forecasting and Social Change 82 (2014), 23–33.
  47. Designing technology for sociotechnical problems: challenges and considerations. IEEE Computer Graphics and Applications 40, 6 (2020), 76–87.
  48. J Nathan Matias and Merry Mou. 2018. CivilServant: Community-led experiments in platform governance. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–13.
  49. Amanda Mergler. 2008. Making the implicit explicit: Values and morals in Queensland teacher education. Australian Journal of Teacher Education (Online) 33, 4 (2008), 1–10.
  50. David G Myers and Helmut Lamm. 1976. The group polarization phenomenon. Psychological bulletin 83, 4 (1976), 602.
  51. A fieldwork of the future with user enactments. In Proceedings of the Designing Interactive Systems Conference. 338–347.
  52. From Information to Choice: A Critical Inquiry Into Visualization Tools for Decision Making. IEEE Transactions on Visualization and Computer Graphics (2023).
  53. Weightlifter: Visual weight space exploration for multi-criteria decision making. IEEE transactions on visualization and computer graphics 23, 1 (2016), 611–620.
  54. Comparing the perceived legitimacy of content moderation processes: Contractors, algorithms, expert panels, and digital juries. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (2022), 1–31.
  55. Galileo: citizen-led experimentation using a social computing system. In Proceedings of the 2021 CHI conference on human factors in computing systems. 1–14.
  56. Social simulacra: Creating populated prototypes for social computing systems. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1–18.
  57. Edward Platt. 2022. Network Deliberation: The Role of Network Structure in Large-Scale, Internet-Enabled, Participatory Decision-Making. Ph. D. Dissertation.
  58. Michael Reddy. 1979. The conduit metaphor. Metaphor and thought 2 (1979), 285–324.
  59. Matthew J Salganik and Karen EC Levy. 2015. Wiki surveys: Open and quantifiable social data collection. PloS one 10, 5 (2015), e0123483.
  60. Herbert A Simon. 1996. Social planning: Designing the evolving artifact. (1996).
  61. Charting the Automation of Hospitality: An Interdisciplinary Literature Review Examining the Evolution of Frontline Service work in the Face of Algorithmic Management. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (2023), 1–20.
  62. Lucille Alice Suchman. 1987. Plans and situated actions: The problem of human-machine communication. Cambridge university press.
  63. Investigating human+ machine complementarity for recidivism predictions. arXiv preprint arXiv:1808.09123 (2018).
  64. The ethics of people analytics: risks, opportunities and recommendations. Personnel Review 51, 3 (2022), 900–921.
  65. Jasmine Urquhart. 2022. Line managers report larger team sizes compared to pre-pandemic, survey finds. https://www.peoplemanagement.co.uk/article/1752229/line-managers-report-larger-team-sizes-compared-pre-pandemic-survey-finds
  66. Challenges for toxic comment classification: An in-depth error analysis. arXiv preprint arXiv:1809.07572 (2018).
  67. Stephen R Watson and Dennis M Buede. 1987. Decision synthesis: The principles and practice of decision analysis. Cambridge University Press.
  68. Xinyi Zhou and Reza Zafarani. 2018. Fake news: A survey of research, detection methods, and opportunities. arXiv preprint arXiv:1812.00315 2 (2018).
  69. Procid: Bridging consensus building theory with the practice of distributed design discussions. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. 686–699.
  70. John Zimmerman and Jodi Forlizzi. 2014. Research through design in HCI. In Ways of Knowing in HCI. Springer, 167–189.
  71. Research through design as a method for interaction design research in HCI. In Proceedings of the SIGCHI conference on Human factors in computing systems. 493–502.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now

Whiteboard

Paper to Video (Beta)

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up

Tweets

Sign up for free to view the 2 tweets with 0 likes about this paper.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up for Free