Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Through the Looking-Glass: Transparency Implications and Challenges in Enterprise AI Knowledge Systems (2401.09410v1)

Published 17 Jan 2024 in cs.CY, cs.AI, and cs.HC

Abstract: Knowledge can't be disentangled from people. As AI knowledge systems mine vast volumes of work-related data, the knowledge that's being extracted and surfaced is intrinsically linked to the people who create and use it. When these systems get embedded in organizational settings, the information that is brought to the foreground and the information that's pushed to the periphery can influence how individuals see each other and how they see themselves at work. In this paper, we present the looking-glass metaphor and use it to conceptualize AI knowledge systems as systems that reflect and distort, expanding our view on transparency requirements, implications and challenges. We formulate transparency as a key mediator in shaping different ways of seeing, including seeing into the system, which unveils its capabilities, limitations and behavior, and seeing through the system, which shapes workers' perceptions of their own contributions and others within the organization. Recognizing the sociotechnical nature of these systems, we identify three transparency dimensions necessary to realize the value of AI knowledge systems, namely system transparency, procedural transparency and transparency of outcomes. We discuss key challenges hindering the implementation of these forms of transparency, bringing to light the wider sociotechnical gap and highlighting directions for future Computer-supported Cooperative Work (CSCW) research.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (109)
  1. Mark S Ackerman. 2000. The intellectual challenge of CSCW: the gap between social requirements and technical feasibility. Human–Computer Interaction 15, 2-3 (2000), 179–203.
  2. Sharing knowledge and expertise: The CSCW view of knowledge management. Computer Supported Cooperative Work (CSCW) 22 (2013), 531–573.
  3. Amazon. 2024. Amazon Q. Retrieved January 15, 2024 from https://aws.amazon.com/q/
  4. Mike Ananny and Kate Crawford. 2018. Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability. new media & society 20, 3 (2018), 973–989.
  5. Varieties of transparency: Exploring agency within AI systems. AI & society 38, 4 (2023), 1321–1331.
  6. Tatiana Andreeva and Aino Kianto. 2012. Does knowledge management really matter? Linking knowledge management practices, competitiveness and economic performance. Journal of knowledge management 16, 4 (2012), 617–636.
  7. Kenneth J Arrow. 1974. The limits of organization. WW Norton & Company.
  8. Atlassian. 2024. Atlassian Intelligence. Retrieved January 15, 2024 from https://www.atlassian.com/software/artificial-intelligence
  9. Determining Expert Profiles (With an Application to Expert Finding).. In IJCAI, Vol. 7. 2657–2662.
  10. Albert Bandura. 1977. Self-efficacy: toward a unifying theory of behavioral change. Psychological review 84, 2 (1977), 191.
  11. Who Am I? A Design Probe Exploring Real-Time Transparency about Online and Offline User Profiling Underlying Targeted Ads. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 3 (2021), 1–32.
  12. Recommending knowledgeable people in a work-integrated learning system. Procedia Computer Science 1, 2 (2010), 2783–2792.
  13. Aparajita Bhandari and Sara Bimo. 2022. Why’s everyone on TikTok now? The algorithmized self and the future of self-making on social media. Social Media+ Society 8, 1 (2022), 20563051221086241.
  14. Bloomfire. 2024. Bloomfire platform. Retrieved January 15, 2024 from https://bloomfire.com/platform/
  15. Herbert Blumer. 1986. Symbolic interactionism: Perspective and method. Univ of California Press.
  16. Susanne Bodker. 2021. Through the interface: A human activity approach to user interface design. CRC Press.
  17. Philip Bonhard and Martina Angela Sasse. 2006. ’Knowing me, knowing you’—Using profiles and social networking to improve recommender systems. BT Technology Journal 24, 3 (2006), 84–98.
  18. Geoffrey C Bowker and Susan Leigh Star. 2000. Sorting things out: Classification and its consequences. MIT press.
  19. Lewis Carrol. 2006. Through the looking glass. Read Books.
  20. Automatic Construction of Enterprise Knowledge Base. arXiv preprint arXiv:2106.15085 (2021).
  21. Matthew Chalmers. 2001. Information awareness and representation. Computer Supported Cooperative Work (CSCW). An International Journal (2001).
  22. Matthew Chalmers and Areti Galani. 2004. Seamful interweaving: heterogeneity in the theory and design of interactive systems. In Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques. 243–252.
  23. Creator-friendly Algorithms: Behaviors, Challenges, and Design Opportunities in Algorithmic Platforms. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–22.
  24. Large Language Models for User Interest Journeys. arXiv preprint arXiv:2305.15498 (2023).
  25. Charles H Christiansen. 1999. Defining lives: Occupation as identity: An essay on competence, coherence, and the creation of meaning. The American Journal of Occupational Therapy 53, 6 (1999), 547–558.
  26. Robert William Clowes. 2020. The internet extended person. Límité. Revista Interdisciplinaria de Filosofía y Psicología (2020), 1–23.
  27. Ronald Harry Coase. 1995. The nature of the firm. Springer.
  28. Charles Horton Cooley. 1902. Looking-glass self. The production of reality: Essays and readings on social interaction 6 (1902), 126–128.
  29. Eric Corbett and Emily Denton. 2023. Interrogating the T in FAccT. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. 1624–1634.
  30. Kimberlé W Crenshaw. 2017. On intersectionality: Essential writings. The New Press.
  31. Jennifer Crocker and Brenda Major. 1989. Social stigma and self-esteem: The self-protective properties of stigma. Psychological review 96, 4 (1989), 608.
  32. Thomas H Davenport and Laurence Prusak. 1998. Working knowledge: How organizations manage what they know. Harvard Business Press.
  33. How people form folk theories of social media feeds and what it means for how we study self-presentation. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–12.
  34. ” Algorithms ruin everything” # RIPTwitter, Folk Theories, and Resistance to Algorithmic Change in Social Media. In Proceedings of the 2017 CHI conference on human factors in computing systems. 3163–3174.
  35. Human-Centered Explainable AI (HCXAI): beyond opening the black-box of AI. In CHI conference on human factors in computing systems extended abstracts. 1–7.
  36. I can’t breathe: Reflections from Black women in CSCW and HCI. Proceedings of the ACM on Human-Computer Interaction 4, CSCW3 (2021), 1–23.
  37. Thomas Erickson and Wendy A Kellogg. 2000. Social translucence: an approach to designing systems that support social processes. ACM transactions on computer-human interaction (TOCHI) 7, 1 (2000), 59–83.
  38. First I” like” it, then I hide it: Folk Theories of Social Feeds. In Proceedings of the 2016 cHI conference on human factors in computing systems. 2371–2382.
  39. Exposure inequality in people recommender systems: the long-term effects. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 16. 194–204.
  40. Maryam Fazel-Zarandi and Mark S Fox. 2011. Constructing expert profiles over time for skills management and expert finding. In Proceedings of the 11th International Conference on Knowledge Management and Knowledge Technologies. 1–6.
  41. Link recommendations: Their impact on network structure and minorities. In Proceedings of the 14th ACM Web Science Conference 2022. 228–238.
  42. Megan Rebecca French. 2018. Algorithmic mirrors: An examination of how personalized recommendations can shape self-perceptions and reinforce gender stereotypes. Stanford University.
  43. Batya Friedman and Peter H Kahn Jr. 2007. Human values, ethics, and design. In The human-computer interaction handbook. CRC press, 1267–1292.
  44. A Framework for Exploring the Consequences of AI-Mediated Enterprise Knowledge Access and Identifying Risks to Workers. arXiv preprint arXiv:2312.10076 (2023).
  45. Viktor Gecas and Michael L Schwalbe. 1983. Beyond the looking-glass self: Social structure and efficacy-based self-esteem. Social psychology quarterly (1983), 77–88.
  46. Glean. 2024. Glean. Retrieved January 15, 2024 from https://www.glean.com/product/workplace-search-ai
  47. Erving Goffman. 2009. Stigma: Notes on the management of spoiled identity. Simon and schuster.
  48. Erving Goffman et al. 2002. The presentation of self in everyday life. 1959. Garden City, NY 259 (2002).
  49. Rodrigo Gonçalves and Carina Friedrich Dorneles. 2019. Automated expertise retrieval: a taxonomy-based survey and open issues. ACM Computing Surveys (CSUR) 52, 5 (2019), 1–30.
  50. Amy L Gonzales and Jeffrey T Hancock. 2008. Identity shift in computer-mediated environments. Media Psychology 11, 2 (2008), 167–185.
  51. Hanneke Grutterink and Alyson Meister. 2022. Thinking of you thinking of me: An integrative review of meta-perception in the workplace. Journal of organizational behavior 43, 2 (2022), 327–341.
  52. Reciprocal expertise affirmation and shared expertise perceptions in work teams: Their implications for coordinated action and team performance. Applied Psychology 62, 3 (2013), 359–381.
  53. Do you know? Recommending people to invite into your social network. In Proceedings of the 14th international conference on Intelligent user interfaces. 77–86.
  54. Supporting exploratory people search: a study of factor transparency and user control. In Proceedings of the 22nd ACM international conference on Information & Knowledge Management. 449–458.
  55. Expert finding systems: A systematic review. Applied Sciences 9, 20 (2019), 4250.
  56. Sarah Inman and David Ribes. 2019. ” Beautiful Seams” Strategic Revelations and Concealments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–14.
  57. Claudiu Gabriel Ionescu and Monica Licu. 2023. Are TikTok Algorithms Influencing Users’ Self-Perceived Identities and Personal Values? A Mini Review. Social Sciences 12, 8 (2023), 465.
  58. William James. 1984. Psychology, briefer course. Vol. 14. Harvard University Press.
  59. Artificial intelligence and knowledge management: A partnership between human and AI. Business Horizons 66, 1 (2023), 87–99.
  60. Privacy, trust, and self-disclosure online. Human–Computer Interaction 25, 1 (2010), 1–24.
  61. Ida Larsen-Ledet and Siân Lindley. 2022. Ways of seeing and being seen: People in the algorithmic knowledge base. In Workshop at the 20th Eur. Conf. Comput.-Supported Cooperative Work.
  62. Ethical and social considerations in automatic expert identification and people recommendation in organizational knowledge management systems. arXiv preprint arXiv:2209.03819 (2022).
  63. Stefan Larsson and Fredrik Heintz. 2020. Transparency in artificial intelligence. Internet Policy Review 9, 2 (2020).
  64. The algorithmic crystal: Conceptualizing the self through algorithmic personalization on TikTok. Proceedings of the ACM on Human-computer Interaction 6, CSCW2 (2022), 1–22.
  65. Working with machines: The impact of algorithmic and data-driven management on human workers. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. 1603–1612.
  66. Work motivation: The incorporation of self-concept-based processes. Human relations 52 (1999), 969–998.
  67. Q Vera Liao and Jennifer Wortman Vaughan. 2023. AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap. arXiv preprint arXiv:2306.01941 (2023).
  68. A survey on expert finding techniques. Journal of Intelligent Information Systems 49 (2017), 255–279.
  69. Siân E Lindley and Denise J Wilkins. 2023. Building Knowledge through Action: Considerations for Machine Learning in the Workplace. ACM Transactions on Computer-Human Interaction (2023).
  70. Brenda Major and Jennifer Crocker. 1993. Social stigma: The consequences of attributional ambiguity. In Affect, cognition and stereotyping. Elsevier, 345–370.
  71. Márcio José Mantau and Fabiane Barreto Vavassori Benitti. 2022. Awareness support in collaborative system: Reviewing last 10 years of cscw research. In 2022 IEEE 25th International Conference on Computer Supported Cooperative Work in Design (CSCWD). IEEE, 564–569.
  72. Catherine C Marshall and Siân E Lindley. 2014. Searching for myself: motivations and strategies for self-search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3675–3684.
  73. Alice E Marwick and Danah Boyd. 2011. I tweet honestly, I tweet passionately: Twitter users, context collapse, and the imagined audience. New media & society 13, 1 (2011), 114–133.
  74. Who is an expert for foresight? A review of identification methods. Technological Forecasting and Social Change 154 (2020), 119982.
  75. George Herbert Mead et al. 1934. Mind, self, and society. Vol. 111. University of Chicago press Chicago.
  76. How feeling misidentified can drive negative attitudes yet increase performance: The role of appraisals. Journal of Applied Social Psychology (2023).
  77. Studying up machine learning data: Why talk about bias when we mean power? Proceedings of the ACM on Human-Computer Interaction 6, GROUP (2022), 1–14.
  78. Microsoft. 2023a. Microsoft Viva. Retrieved October 18, 2023 from https://www.microsoft.com/en-us/microsoft-viva
  79. Microsoft. 2023b. Topics in Viva Connections. Retrieved January 15, 2024 from https://learn.microsoft.com/en-us/microsoft-365/topics/topics-card-viva-connections?view=o365-worldwide
  80. Microsoft. 2023c. Viva Topics. Retrieved October 18, 2023 from https://learn.microsoft.com/en-us/microsoft-365/topics/topic-experiences-overview?view=o365-worldwide
  81. Microsoft. 2024a. Microsoft Copilot 365. Retrieved January 15, 2024 from https://www.microsoft.com/en-us/microsoft-365/enterprise/copilot-for-microsoft-365#tabs-pill-bar-oca455_tab1
  82. Microsoft. 2024b. Microsoft Copilot for Work. Retrieved January 15, 2024 from https://www.microsoft.com/en-us/microsoft-365/copilot-for-work#tabs-pill-bar-oc58d2_tab5
  83. Metaphors for designers working with AI. (2022).
  84. Devesh Narayanan. 2023. Welfarist Moral Grounding for Transparent AI. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. 64–76.
  85. Ikujiro Nonaka. 1994. A dynamic theory of organizational knowledge creation. Organization science 5, 1 (1994), 14–37.
  86. A study of preferences for sharing and privacy. In CHI’05 extended abstracts on Human factors in computing systems. 1985–1988.
  87. Wanda J Orlikowski. 2002. Knowing in practice: Enacting a collective capability in distributed organizing. Organization science 13, 3 (2002), 249–273.
  88. Leysia Palen and Paul Dourish. 2003. Unpacking” privacy” for a networked world. In Proceedings of the SIGCHI conference on Human factors in computing systems. 129–136.
  89. Marta Pérez-Verdugo. 2022. Situating Transparency: An Extended Cognition Approach. Teorema 41, 3 (2022).
  90. On Natural Language User Profiles for Transparent and Scrutable Recommendation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2863–2874.
  91. Sociotechnical harms of algorithmic systems: Scoping a taxonomy for harm reduction. In Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society. 723–741.
  92. Joseph E Stiglitz. 2000. The contributions of the economics of information to twentieth century economics. The quarterly journal of economics 115, 4 (2000), 1441–1478.
  93. Social transparency in networked information exchange: a theoretical framework. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. 451–460.
  94. An audience of one: Behaviorally targeted ads as implied social labels. Journal of Consumer Research 43, 1 (2016), 156–178.
  95. Henri Tajfel. 1978. Social categorization, social identity and social comparison. Differentiation between social group (1978), 61–76.
  96. The knowledge management puzzle: Human and social factors in knowledge management. IBM systems journal 40, 4 (2001), 863–884.
  97. Dianne M Tice. 1992. Self-concept change and self-presentation: the looking glass self is also a magnifying glass. Journal of personality and social psychology 63, 3 (1992), 435.
  98. Sarah J Tracy and Angela Trethewey. 2005. Fracturing the real-self fake-self dichotomy: Moving toward “crystallized” organizational discourses and identities. Communication theory 15, 2 (2005), 168–195.
  99. Chun-Hua Tsai and Peter Brusilovsky. 2018. Beyond the ranked list: User-driven exploration and diversification of social recommendation. In 23rd international conference on intelligent user interfaces. 239–250.
  100. Chun-Hua Tsai and Peter Brusilovsky. 2021. The effects of controllability and explainability in a social recommender system. User Modeling and User-Adapted Interaction 31 (2021), 591–627.
  101. Warren J von Eschenbach. 2021. Transparency and the black box problem: Why we do not trust AI. Philosophy & Technology 34, 4 (2021), 1607–1622.
  102. Designing AI systems that make organizational knowledge actionable. Interactions 27, 6 (2020), 72–75.
  103. Enterprise Alexandria: Online high-precision enterprise knowledge base construction with typed entities. In 3rd Conference on Automated Knowledge Base Construction.
  104. Christine T Wolf. 2016. Seeing work: constructing visions of work in and through data. In Proceedings of the 2016 ACM International Conference on Supporting Group Work. 509–512.
  105. Christine T Wolf. 2020. From knowledge graphs to knowledge practices: On the need for transparency and explainability in enterprise knowledge graph applications. In Proceedings of the KG-BIAS Workshop 2020 at AKBC 2020.
  106. How Does the System Perceive Me?—A Transparent and Tunable Recommender System. In International Conference on Database and Expert Systems Applications. Springer, 33–48.
  107. Dawit Yimam-Seid and Alfred Kobsa. 2003. Expert-finding systems for organizations: Problem and domain analysis and the DEMOIR approach. Journal of Organizational Computing and Electronic Commerce 13, 1 (2003), 1–24.
  108. Kenji Yoshino. 2006. The pressure to cover. New York Times Magazine 32 (2006).
  109. Valentin Zieglmeier and Alexander Pretschner. 2023. Rethinking people analytics with inverse transparency by design. arXiv preprint arXiv:2305.09813 (2023).

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets