Invisible Labor in Open Source Software Ecosystems (2401.06889v1)
Abstract: Invisible labor is work that is not fully visible, not appropriately compensated, or both. In open source software (OSS) ecosystems, essential tasks that do not involve code (like content moderation) often become invisible to the detriment of individuals and organizations. However, invisible labor is so difficult to measure that we do not know how much of OSS activities are invisible. Our study addresses this challenge, demonstrating that roughly half of OSS work is invisible. We do this by developing a survey technique with cognitive anchoring that measures OSS developer self-assessments of labor visibility and attribution. Survey respondents (n=142) reported that their work is more likely to be nonvisible or partially visible (i.e. visible to at most 1 other person) than fully visible (i.e. visible to 2 or more people). Furthermore, cognitively anchoring participants to the idea of high work visibility increased perceptions of labor visibility and decreased visibility importance compared to anchoring to low work visibility. This suggests that advertising OSS activities as "open" may not make labor visible to most people, but rather lead contributors to overestimate labor visibility. We therefore add to a growing body of evidence that designing systems that recognize all kinds of labor as legitimate contributions is likely to improve fairness in software development while providing greater transparency into work designs that help organizations and communities achieve their goals.
- Joan Acker. 1973. Women and Social Stratification: A Case of Intellectual Sexism. Amer. J. Sociology 78, 4 (Jan. 1973), 936–945. https://doi.org/10.1086/225411
- Publishing: Credit Where Credit Is Due. Nature 508, 7496 (April 2014), 312–313. https://doi.org/10.1038/508312a
- Gender Differences in Accepting and Receiving Requests for Tasks with Low Promotability. American Economic Review 107, 3 (2017), 714–747.
- Shaowen Bardzell. 2010. Feminist HCI: Taking Stock and Outlining an Agenda for Design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’10). Association for Computing Machinery, New York, NY, USA, 1301–1310. https://doi.org/10.1145/1753326.1753521
- Work as a Masculinity Contest. Journal of Social Issues 74, 3 (2018), 422–448. https://doi.org/10.1111/josi.12289
- Beyond Authorship: Attribution, Contribution, Collaboration, and Credit. Learned Publishing 28, 2 (2015), 151–155. https://doi.org/10.1087/20150211
- Open Source Ecosystems Need Equitable Credit across Contributions. Nature Computational Science 1, 1 (Jan. 2021), 2–2. https://doi.org/10.1038/s43588-020-00011-w
- Miriam A Cherry. 2016. Virtual Work and Invisible Labor. In Invisible Labour: Hidden Work in the Contemporary World, Marion G. Crain, Winifred R. Poster, and Miriam A. Cherry (Eds.). University of California Press, Oakland, California, 28–46.
- Strategies for Estimating Behavioural Frequency in Survey Interviews. Memory 6, 4 (July 1998), 339–366. https://doi.org/10.1080/741942603
- Arlene Kaplan Daniels. 1987. Invisible Work. Social Problems 34, 5 (Dec. 1987), 403–415. https://doi.org/10.2307/800538
- Catherine D’Ignazio and Lauren F Klein. 2020. Data Feminism. MIT Press, Cambridge, MA.
- Nadia Eghbal. 2016. Roads and Bridges: The Unseen Labor behind Our Digital Infrastructure. Technical Report. Ford Foundation.
- Nadia Eghbal. 2020. Working in Public: The Making and Maintenance of Open Source Software. Stripe Press, San Francisco, CA.
- Yulin Fang and Derrick Neufeld. 2009. Understanding Sustained Participation in Open Source Software Projects. Journal of Management Information Systems 25, 4 (April 2009), 9–50. https://doi.org/10.2753/MIS0742-1222250401
- Gender and Participation in Open Source Software Development. Proc. ACM Hum.-Comput. Interact. 6, CSCW2 (Nov. 2022), 299:1–299:31. https://doi.org/10.1145/3555190
- The Labor of Maintaining and Scaling Free and Open-Source Software Projects. Proc. ACM Hum.-Comput. Interact. 5, CSCW1 (April 2021), 175:1–175:28. https://doi.org/10.1145/3449249
- Skills, Division of Labor and Performance in Collective Inventions: Evidence from Open Source Software. International Journal of Industrial Organization 28, 1 (Jan. 2010), 54–68. https://doi.org/10.1016/j.ijindorg.2009.07.004
- Measuring Developer Contribution from Software Repository Data. In Proceedings of the 2008 International Working Conference on Mining Software Repositories (MSR ’08). Association for Computing Machinery, New York, NY, USA, 129–132. https://doi.org/10.1145/1370750.1370781
- Mary L. Gray and Siddharth Suri. 2019. Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass. Houghton Mifflin Harcourt, Boston.
- Alex O. Holcombe. 2019. Contributorship, Not Authorship: Use CRediT to Indicate Who Did What. Publications 7, 3 (Sept. 2019), 48. https://doi.org/10.3390/publications7030048
- A Review of Key Likert Scale Development Advances: 1995–2019. Frontiers in Psychology 12 (2021), 1590. https://doi.org/10.3389/fpsyg.2021.637547
- Judgment under Uncertainty: Heuristics and Biases. Cambridge University Press., Cambridge, UK.
- Ivar Krumpal. 2013. Determinants of Social Desirability Bias in Sensitive Surveys: A Literature Review. Qual Quant 47, 4 (June 2013), 2025–2047. https://doi.org/10.1007/s11135-011-9640-9
- Contributorship and Division of Labor in Knowledge Production. Social Studies of Science 46, 3 (2016), 417–435. arXiv:26099848
- Cognitive Burden of Survey Questions and Response Times: A Psycholinguistic Experiment. Applied Cognitive Psychology 24, 7 (Oct. 2010), 1003–1020. https://doi.org/10.1002/acp.1602
- Designing for Collaborative Infrastructuring: Supporting Resonance Activities. Proc. ACM Hum.-Comput. Interact. 2, CSCW (Nov. 2018), 1–29. https://doi.org/10.1145/3274382
- Daniel McNeish. 2018. Thanks Coefficient Alpha, We’ll Take It from Here. Psychological Methods 23, 3 (Sept. 2018), 412–433. https://doi.org/10.1037/met0000144
- Daniel C. Molden. 2014. Understanding Priming Effects in Social Psychology: What Is “Social Priming” and How Does It Occur? Social Cognition 32, Supplement (June 2014), 1–11. https://doi.org/10.1521/soco.2014.32.supp.1
- Computers Can’t Give Credit: How Automatic Attribution Falls Short in an Online Remixing Community. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’11). Association for Computing Machinery, Vancouver, BC, Canada, 3421–3430. https://doi.org/10.1145/1978942.1979452 arXiv:1507.01285
- National Science Foundation. 2023. Pathways to Enable Open-Source Ecosystems. Program Solicitation NSF 23-556. National Science Foundation.
- Introduction: Conceptualizing Invisible Labor. In Invisible Labor: Hidden Work in the Contemporary World, Marion G. Crain, Winifred R. Poster, and Miriam A. Cherry (Eds.). University of California Press, Oakland, California, 3–27.
- More than Code: Contributions in Scrum Software Engineering Teams. In Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops (ICSEW’20). Association for Computing Machinery, New York, NY, USA, 137–140. https://doi.org/10.1145/3387940.3392241
- Dirk Riehle. 2007. The Economic Motivation of Open Source Software: Stakeholder Perspectives. Computer 40, 4 (April 2007), 25–32. https://doi.org/10.1109/MC.2007.147
- Kjeld Schmidt and Liam Bannon. 1992. Taking CSCW Seriously. Comput Supported Coop Work 1, 1 (March 1992), 7–40. https://doi.org/10.1007/BF00752449
- Kjeld Schmidt and Carla Simone. 1996. Coordination Mechanisms: Towards a Conceptual Foundation of CSCW Systems Design. Computer Supported Cooperative Work (CSCW) 5 (1996), 155–200.
- Susan Leigh Star. 1991. The Sociology of the Invisible: The Primacy of Work in the Writings of Anselm Strauss. In Social Organization and Social Process: Essays in Honor of Anselm Strauss, David R. Maines (Ed.). Walter de Gruyter, Inc., Hawthorne, NY, 265–283.
- Susan Leigh Star and Anselm Strauss. 1999. Layers of Silence, Arenas of Voice: The Ecology of Visible and Invisible Work. Computer supported cooperative work (CSCW) 8 (1999), 9–30.
- Daniel Stewart. 2005. Social Status in an Open-Source Community. Am Sociol Rev 70, 5 (Oct. 2005), 823–842. https://doi.org/10.1177/000312240507000505
- Managing Opacity: Information Visibility and the Paradox of Transparency in the Digital Age. International Journal of Communication 10, 0 (Jan. 2016), 15.
- Anselm Strauss. 1985. Work and the Division of Labor. The Sociological Quarterly 26, 1 (1985), 1–19. https://doi.org/10.1111/j.1533-8525.1985.tb00212.x
- Lucy Suchman. 1995. Making Work Visible. Commun. ACM 38, 9 (Sept. 1995), 56–64. https://doi.org/10.1145/223248.223263
- Assessing Organizational Information Visibility: Development and Validation of the Information Visibility Scale. Communication Research 48, 6 (Aug. 2021), 895–927. https://doi.org/10.1177/0093650219877093
- Roger Tourangeau. 2018. The Survey Response Process from a Cognitive Viewpoint. Quality Assurance in Education 26, 2 (Jan. 2018), 169–181. https://doi.org/10.1108/QAE-06-2017-0034
- The Science of Web Surveys. Oxford University Press, New York, NY.
- The Psychology of Survey Response. Cambridge University Press, Cambridge, UK.
- Quantifying the Invisible Labor in Crowd Work. Proc. ACM Hum.-Comput. Interact. 5, CSCW2 (Oct. 2021), 319:1–319:26. https://doi.org/10.1145/3476060
- Hidden Figures: Roles and Pathways of Successful OSS Contributors. Proc. ACM Hum.-Comput. Interact. 4, CSCW2 (Oct. 2020), 1–22. https://doi.org/10.1145/3415251
- The Penumbra of Open Source: Projects Outside of Centralized Platforms Are Longer Maintained, More Academic and More Collaborative. EPJ Data Sci. 11, 1 (Dec. 2022), 31. https://doi.org/10.1140/epjds/s13688-022-00345-7
- Carrots and Rainbows: Motivation and Social Practice in Open Source Software Development. MIS Quarterly 36, 2 (2012), 649–676. https://doi.org/10.2307/41703471 arXiv:41703471
- Which Contributions Count? Analysis of Attribution in Open Source. In 2021 IEEE/ACM 18th International Conference on Mining Software Repositories (MSR). IEEE, Madrid, Spain, 242–253. https://doi.org/10.1109/MSR52588.2021.00036