Diversity's Double-Edged Sword: Analyzing Race's Effect on Remote Pair Programming Interactions (2404.07427v1)
Abstract: Remote pair programming is widely used in software development, but no research has examined how race affects these interactions. We embarked on this study due to the historical under representation of Black developers in the tech industry, with White developers comprising the majority. Our study involved 24 experienced developers, forming 12 gender-balanced same- and mixed-race pairs. Pairs collaborated on a programming task using the think-aloud method, followed by individual retrospective interviews. Our findings revealed elevated productivity scores for mixed-race pairs, with no differences in code quality between same- and mixed-race pairs. Mixed-race pairs excelled in task distribution, shared decision-making, and role-exchange but encountered communication challenges, discomfort, and anxiety, shedding light on the complexity of diversity dynamics. Our study emphasizes race's impact on remote pair programming and underscores the need for diverse tools and methods to address racial disparities for collaboration.
- [n. d.]. https://ips-dc.org/wp-content/uploads/2019/01/IPS_RWD-Report_FINAL-1.15.19.pdf
- [n. d.]. https://www.census.gov/content/dam/Census/library/publications/2016/demo/p20-578.pdf
- [n. d.]. https://bjs.ojp.gov/content/pub/pdf/p17.pdf
- [n. d.]. https://www.crf-usa.org/black-history-month/the-constitution-and-slavery
- [n. d.]. https://drive.google.com/drive/folders/1Sb8k9_2AzJnGK97s0vL8e-2fJ8gaPu5w?usp=drive_link
- [n. d.]. https://stanfordvr.com/1000cut/
- 2015. Google’s algorithm shows prestigious job ads to men, but not to women. https://www.independent.co.uk/tech
- 2019. https://www.nytimes.com/interactive/2019/08/14/magazine/1619-america-slavery.html?mtrref=undefined&gwh=AA520C829192CC8AF8894579A780882E&gwt=pay&assetType=PAYWALL
- 2020. https://www.youtube.com/watch?v=fMxU4D0pO6Q
- 2020. GenderMag. http://gendermag.org/
- 2021. https://www.youtube.com/watch?v=GkvxHnC7Zzo
- Investigating Remote Pair Programming In Part-Time Distance Education. In Proceedings of the 2021 Conference on United Kingdom & Ireland Computing Education Research. 1–7.
- Agile software development one year into the COVID-19 pandemic. Empirical Software Engineering 27, 6 (2022), 121.
- People like me: Providing relatable and realistic role models for underrepresented minorities in STEM to increase their motivation and likelihood of success. In 2018 IEEE integrated STEM education conference (ISEC). IEEE, 83–89.
- Sharla N Alegria and Enobong Hannah Branch. 2015. Causes and Consequences of Inequality in the STEM: Diversity and its Discontents. International Journal of Gender, Science and Technology 7, 3 (2015), 321–342.
- Arif ALTUN and Sacide Güzin MAZMAN. 2012. Programlamaya ilişkin öz yeterlilik algısı ölçeğinin Türkçe formunun güvenirlik ve geçerlik çalışması. Journal of Measurement and Evaluation in Education and Psychology 3, 2 (2012), 297–308.
- Machine bias. https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing
- Anonymous. 2019. The Reality of Racism Comes to Life in VR Film. https://news.columbia.edu/news/reality-racism-comes-life-vr-film
- Anonymous. 2023. Who Am I? Race Awareness Game. https://www.commonsense.org/education/reviews/who-am-i-race-awareness-game#:~:text=Who%20Am%20I%3F%20is%20a,that%20make%20sense%20to%20themselves.
- Using zoom videoconferencing for qualitative data collection: perceptions and experiences of researchers and participants. International journal of qualitative methods 18 (2019), 1609406919874596.
- Elizabeth Aries. 1987. Gender and communication. Sage Publications, Inc.
- Arthur Ashe and A Rampersad. 1993. Days ofgrace: A memoir.
- Mark Attridge. 2019. A global perspective on promoting workplace mental health and the role of employee assistance programs. , 622–629 pages.
- Carl Auerbach and Louise B Silverstein. 2003. Qualitative data: An introduction to coding and analysis. Vol. 21. NYU press.
- D. C. Hoaglin B. A. Kitchenham, S. L. Pfleeger and J. Rosenberg. 2002. ”Preliminary Guidelines for Empirical Research in Software Engineering”. In IEEE Transactions on Software Engineering, Vol. 28. 721–734.
- Are two heads better than one for software development? The productivity paradox of pair programming. MIS quarterly (2009), 91–118.
- Carl Barenboim. 1981. The development of person perception in childhood and adolescence: From behavioral comparisons to psychological constructs to psychological comparisons. Child development (1981), 129–144.
- Paul E Barton. 2003. Parsing the Achievement Gap: Baselines for Tracking Progress. Policy Information Report. (2003).
- The transformational and transactional leadership of men and women. Applied psychology 45, 1 (1996), 5–34.
- Bernard M Bass and Ruth Bass. 2008. Handbook of leadership: Theory, research, and application. Free Press.
- Bernard M Bass and Ralph Melvin Stogdill. 1990. Bass & Stogdill’s handbook of leadership: Theory, research, and managerial applications. Simon and Schuster.
- Collaboration in global software projects at siemens: An experience report. In International Conference on Global Software Engineering (ICGSE 2007). IEEE, 33–39.
- Talya N Bauer and Stephen G Green. 1996. Development of leader-member exchange: A longitudinal test. Academy of management journal 39, 6 (1996), 1538–1567.
- Kent Beck. 2022. Test driven development: By example. Addison-Wesley Professional.
- Katrin Becker. 2003. Grading programming assignments using rubrics. In Proceedings of the 8th annual conference on Innovation and technology in computer science education. 253–253.
- Andrew Begel and Nachi Nagappan. 2008a. Pair programming: What’s in it For Me?. In ESEM ’08: Proceedings of the Second ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM ’08: Proceedings of the Second ACM-IEEE International Symposium on Empirical Software Engineering and Measurement ed.). ACM, 120–128.
- Andrew Begel and Nachiappan Nagappan. 2008b. Pair programming: what’s in it for me?. In Proceedings of the Second ACM-IEEE international symposium on Empirical software engineering and measurement. 120–128.
- Asynchronous Technical Interviews: Reducing the Effect of Supervised Think-Aloud on Communication Ability. In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (Singapore, Singapore) (ESEC/FSE 2022). Association for Computing Machinery, New York, NY, USA, 294–305. https://doi.org/10.1145/3540250.3549168
- Debugging hiring: What went right and what went wrong in the technical interview process. In Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering: Software Engineering in Society. 71–80.
- Stereotype threat and working memory: mechanisms, alleviation, and spillover. Journal of Experimental Psychology: General 136, 2 (2007), 256.
- Nicole Bergen and Ronald Labonté. 2020. “Everything is perfect, and we have no problems”: detecting and limiting social desirability bias in qualitative research. Qualitative health research 30, 5 (2020), 783–792.
- Guidelines for the use of pair programming in a freshman programming class. In Proceedings 15th Conference on Software Engineering Education and Training (CSEE&T 2002). IEEE, 100–107.
- Pair Programming in Software Development Teams - An Empirical Study of Its Benefits. Inf. Softw. Technol. 50, 3 (Feb. 2008), 231–240. https://doi.org/10.1016/j.infsof.2007.05.006
- African Americans and high blood pressure: The role of stereotype threat. Psychological science 12, 3 (2001), 225–229.
- Racial discrimination and Redlining in cities. Technical Report. Université catholique de Louvain, Center for Operations, Research & Econometrics.
- Liat Bodaker and Rinat B Rosenberg-Kima. 2023. Online pair-programming: Elementary school children learning scratch together online. Journal of Research on Technology in Education 55, 5 (2023), 799–816.
- David S Bogen. 2023. From Racial Discrimination to Separate but Equal: The Common Law Impact of the Thirteenth Amendment. Ohio Northern University Law Review 38, 1 (2023), 3.
- When saying and doing diverge: The effects of stereotype threat on self-reported versus non-verbal anxiety. Journal of experimental social psychology 40, 2 (2004), 247–255.
- Geoffrey C Bowker and Susan Leigh Star. 2000. Sorting things out: Classification and its consequences. MIT press.
- How prior programming experience affects students’ pair programming experiences and outcomes. In Proceedings of the 2019 ACM Conference on innovation and technology in computer science education. 170–175.
- The impact of pair programming on college students’ interest, perceptions, and achievement in computer science. ACM Transactions on Computing Education 21, 3 (2021), 1–19.
- The case for pair programming in the computer science classroom. ACM Transactions on Computing Education (TOCE) 11, 1 (2011), 1–21.
- Tim Brown. 2009. Change by Design: How Design Thinking Transforms Organizations and Inspires Innovation. HarperBusiness.
- Irene Browne. 2000. Latinas and African American women at work: Race, gender, and economic inequality. Russell Sage Foundation.
- Ryan Browne. 2020. The 150 billion video game industry grapples with a murky track record on diversity. https://www.cnbc.com/2020/08/14/video-game-industry-grapples-with-murky-track-record-on-diversity.html
- Sallyann Bryant. 2004. Double trouble: Mixing qualitative and quantitative methods in the study of extreme programmers. In 2004 IEEE symposium on visual languages-human centric computing. IEEE, 55–61.
- Pair programming and the re-appropriation of individual tools for collaborative software development. Frontiers in Artificial Intelligence and Applications 137 (2006), 55.
- Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency. PMLR, 77–91.
- US Census Bureau. 2022. About the topic of race. https://www.census.gov/topics/population/race/about.html
- The State of US Science & Engineering 2022. National Science Board Science & Engineering Indicators. NSB-2022-1. National Science Foundation (2022).
- Gender Differences and Programming Environments: Across Programming Populations. In Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM ’10). ACM, 28:1–28:10.
- GenderMag: A Method for Evaluating Software’s Gender Inclusiveness. Interacting with Computers forthcoming (01 2016). https://doi.org/10.1093/iwc/iwv046
- Raquel R Cabral and Timothy B Smith. 2011. Racial/ethnic matching of clients and therapists in mental health services: a meta-analytic review of preferences, perceptions, and outcomes. Journal of counseling psychology 58, 4 (2011), 537.
- Karen I Case. 1997. African American othermothering in the urban elementary school. The Urban Review 29, 1 (1997), 25–39.
- Mehmet Celepkolu and Kristy Elizabeth Boyer. 2018. Thematic Analysis of Students’ Reflections on Pair Programming in CS1. In Proceedings of the 49th ACM Technical Symposium on Computer Science Education (Baltimore, Maryland, USA) (SIGCSE ’18). Association for Computing Machinery, New York, NY, USA, 771–776. https://doi.org/10.1145/3159450.3159516
- Factors Affecting the Perceived Effectiveness of Pair Programming in Higher Education.. In PPIG. 2.
- Incorporating geographical location for team formation in social coding sites. World Wide Web 23 (2020), 153–174.
- Collecting and reporting race and ethnicity data in HCI. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–8.
- Why, when, and from whom: considerations for collecting and reporting race and ethnicity data in HCI. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–15.
- Kyungsub S Choi. 2013. Evaluating gender significance within a pair programming context. In 2013 46th Hawaii International Conference on System Sciences. IEEE, 4817–4825.
- Kyungsub Stephen Choi. 2015a. A comparative analysis of different gender pair combinations in pair programming. Behaviour & Information Technology 34, 8 (2015), 825–837.
- Kyungsub Stephen Choi. 2015b. A comparative analysis of different gender pair combinations in pair programming. Behaviour & Information Technology 34, 8 (2015), 825–837.
- Pair dynamics in team collaboration. Computers in Human Behavior 25, 4 (2009), 844–852.
- Jan Chong and Tom Hurlbutt. 2007a. The Social Dynamics of Pair Programming. In Proceedings of the 29th International Conference on Software Engineering (ICSE ’07). IEEE Computer Society, USA, 354–363. https://doi.org/10.1109/ICSE.2007.87
- Jan Chong and Tom Hurlbutt. 2007b. The social dynamics of pair programming. In 29th International Conference on Software Engineering (ICSE’07). IEEE, 354–363.
- Daniel C Cliburn. 2003. Experiences with pair programming at a small college. Journal of Computing Sciences in Colleges 19, 1 (2003), 20–29.
- Patricia Hill Collins and Sirma Bilge. 2020. Intersectionality. John Wiley & Sons.
- Deborah R Compeau and Christopher A Higgins. 1995. Computer self-efficacy: Development of a measure and initial test. MIS quarterly (1995), 189–211.
- Exploring the impact of exposing CS majors to programming concepts using IDE programming vs. non-IDE programming in the classroom. In Proceedings of the 51st ACM Technical Symposium on Computer Science Education. 1422–1422.
- Kimberle Crenshaw. 1997. Mapping the margins: Intersectionality, identity politics, and violence against women of color. The legal response to violence against women 5 (1997), 91.
- Gender differences in leadership styles as a function of leader and subordinates’ sex and type of organization. Journal of Applied Social Psychology 42, 12 (2012), 3083–3113.
- On the grounds of solutionism: Ontologies of blackness and HCI. ACM Transactions on Computer-Human Interaction 30, 2 (2023), 1–17.
- Austen Dake. 2022. 2020 state of salaries report: Salary benchmarks and talent preferences. https://hired.com/blog/highlights/2020-state-of-salaries-report/
- Carsten KW De Dreu and Laurie R Weingart. 2003. Task versus relationship conflict, team performance, and team member satisfaction: a meta-analysis. Journal of applied Psychology 88, 4 (2003), 741.
- Benefits and Limitations of Remote Work to LGBTQIA+ Software Professionals. In Proceedings of the 45th IEEE/ACM International Conference on Software Engineering (ICSE 2023).
- Edward L Deci. 1971. Effects of externally mediated rewards on intrinsic motivation. Journal of personality and Social Psychology 18, 1 (1971), 105.
- Richard Delgado and Jean Stefancic. 2023. Critical race theory: An introduction. Vol. 87. NyU press.
- Pair programming: Under what conditions is it advantageous for middle school students? Journal of Research on Technology in Education 46, 3 (2014), 277–296.
- It’s not all about” Green” energy use in low-income communities. In Proceedings of the 11th international conference on Ubiquitous computing. 255–264.
- Robert L Dipboye and Adrienne Colella. 2013. Discrimination at work: The psychological and organizational bases. Psychology Press.
- Andrea A DiSessa. 2000. Changing minds: Computers, learning, and literacy. Mit Press.
- John F Dovidio. 2001. On the nature of contemporary prejudice: The third wave. Journal of social issues 57, 4 (2001), 829–849.
- Diversity Awareness in Software Engineering Participant Research. arXiv preprint arXiv:2302.00042 (2023).
- Are Two Heads Better than One? On the Effectiveness of Pair Programming. Software, IEEE 24 (12 2007), 12 – 15. https://doi.org/10.1109/MS.2007.158
- Alice H Eagly and Blair T Johnson. 1990. Gender and leadership style: A meta-analysis. Psychological bulletin 108, 2 (1990), 233.
- Creativity and education: Why it matters. Retrieved September 18th, 2019 from http://www.adobe.com/aboutadobe/pressroom/pdfs/Adobe_Creativity_and_Education_Why_It_Matters_study.pdf
- Anne Edwards. 2012. The role of common knowledge in achieving collaboration across practices. Learning, Culture and Social Interaction 1, 1 (2012), 22–32.
- Race, ethnicity and pain. Pain 94, 2 (2001), 133–137.
- Katherine TU Emerson and Mary C Murphy. 2015. A company I can trust? Organizational lay theories moderate stereotype threat for women. Personality and Social Psychology Bulletin 41, 2 (2015), 295–307.
- Jasmin Enayati. 2002. The research: Effective communication and decision-making in diverse groups. Multi-stakeholder processes for governance and sustainability: Beyond deadlock and conflict (2002), 73–95.
- An intersectional approach to designing in the margins. Interactions 25, 3 (2018), 66–69.
- Sheena L Erete. 2015. Engaging around neighborhood issues: How online communication affects offline behavior. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. 1590–1601.
- Can Machine Learning Facilitate Remote Pair Programming? Challenges, Insights Implications. In VL/HCC. 1–11.
- Joe R Feagin. 1995. Living with racism: The black middle-class experience. Beacon Press.
- Joe R Feagin and Karyn D McKinney. 2005. The many costs of racism. Rowman & Littlefield Publishers.
- Traveling while black on oculus quest 2. https://www.oculus.com/experiences/quest/2121787737926354/?utm_source=www.wilsoncenter.org&utm_medium=oculusredirect&store&item_id=2121787737926354
- Voting laws, educational policies, and minority turnout. The Journal of Law and Economics 34, 2, Part 1 (1991), 371–393.
- Murray J Fisher and Andrea P Marshall. 2009. Understanding descriptive statistics. Australian critical care 22, 2 (2009), 93–97.
- How Remote Work Can Foster a More Inclusive Environment for Transgender Developers. In 2019 IEEE/ACM 2nd International Workshop on Gender Equality in Software Engineering (GE). 9–12.
- Pair programming in a pandemic: Understanding middle school students’ remote collaboration experiences. In Proceedings of the 53rd ACM Technical Symposium on Computer Science Education-Volume 1. 335–341.
- Author: Gitnux. 2023. The most surprising diversity in tech statistics and Trends in 2023 • gitnux. https://blog.gitnux.com/diversity-in-tech-statistics/#:~:text=According%20to%20a%202020%20report,and%20Black%20employees%20(6.1%25).
- David T Goode-Cross and Karen Ann Grim. 2016. “An Unspoken Level of Comfort” Black Therapists’ Experiences Working With Black Clients. Journal of Black Psychology 42, 1 (2016), 29–53.
- John Gramlich. 2019. The gap between the number of blacks and whites in prison is shrinking. https://www.pewresearch.org/short-reads/2019/04/30/shrinking-gap-between-number-of-blacks-and-whites-in-prison/
- Agile Processes in Software Engineering and Extreme Programming: 22nd International Conference on Agile Software Development, XP 2021, Virtual Event, June 14–18, 2021, Proceedings. Springer Nature.
- EatWell: sharing nutrition-related memories in a low-income community. In Proceedings of the 2008 ACM conference on Computer supported cooperative work. 87–96.
- Local search for string problems: Brute-force is essentially optimal. Theoretical Computer Science 525 (2014), 30–41.
- Patricia Gurin. 1999. New research on the benefits of diversity in college and beyond: An empirical analysis. Diversity Digest 3, 3 (1999), 5–15.
- Think leader, think White? Capturing and weakening an implicit pro-White leadership bias. PLoS One 9 (2014), e83915. Issue 1. https://doi.org/10.1371/journal.pone.0083915
- The Impact of a Peer-Learning Agent Based on Pair Programming in a Programming Course. Education, IEEE Transactions on 53 (06 2010), 318 – 327. https://doi.org/10.1109/TE.2009.2019121
- Brian Hanks. 2005. Student performance in CS1 with distributed pair programming. ACM SIGCSE Bulletin 37, 3 (2005), 316–320.
- Effects of personality on pair programming. IEEE Transactions on Software Engineering 36, 1 (2009), 61–80.
- Anxiety and depression in the workplace: effects on the individual and organisation (a focus group investigation). Journal of affective disorders 88, 2 (2005), 209–215.
- Michelle R Hebl and John F Dovidio. 2005. Promoting the “social” in the examination of social stigmas. Personality and social psychology review 9, 2 (2005), 156–182.
- Bayesian sparse reconstruction: a brute-force approach to astronomical imaging and machine learning. Monthly Notices of the Royal Astronomical Society 483, 4 (2019), 4828–4846.
- Kartik Hosanagar. 2020. A human’s guide to machine intelligence: how algorithms are shaping our lives and how we can stay in control. Penguin.
- A qualitative look at Alice and pair-programming. Number 7 (08 2009).
- Elizabeth V Howard. 2006. Attitudes on using pair-programming. Journal of Educational Technology Systems 35, 1 (2006), 89–103.
- Remote pair programming. In 12th International Conference on Computer Supported Education. SciTePress, 476–483.
- William Ickes. 1984. Compositions in Black and White: Determinants of interaction in interracial dyads. Journal of Personality and Social Psychology 47, 2 (1984), 330.
- Yuto Ikeda and Shun Shiramatsu. 2017. Generating questions asked by facilitator agents using preceding context in web-based discussion. In 2017 IEEE International conference on agents (ICA). IEEE, 127–132.
- Wsevolod W Isajiw. 1993. Definition and dimensions of ethnicity: A theoretical framework. Challenges of measuring an ethnic world: Science, politics and reality (1993), 407–427.
- Scott G. Isaksen and Donald J. Treffinger. 2004. Celebrating 50 years of Reflective Practice: Versions of Creative Problem Solving. The Journal of Creative Behavior 38, 2 (June 2004), 75–101.
- Paul Jaccard. 1901. Etude de la distribution florale dans une portion des Alpes et du Jura. Bulletin de la Societe Vaudoise des Sciences Naturelles 37 (01 1901), 547–579. https://doi.org/10.5169/seals-266450
- Composition of the workplace and psychological well-being: The effects of tokenism on America’s Black elite. Social Forces 74, 2 (1995), 543–557.
- Murrey Jacobson. 2014. Google finally discloses its diversity record, and it’s not good. PBS News Hour (2014).
- Vasudevan Janarthanan. 2012. Serious video games: Games for education and health. In 2012 Ninth International Conference on Information Technology-New Generations. IEEE, 875–878.
- Eric Jensen. 2022. Measuring racial and ethnic diversity for the 2020 census. https://www.census.gov/newsroom/blogs/random-samplings/2021/08/measuring-racial-ethnic-diversity-2020-census.html
- Xiaoming Jiang and Marc D. Pell. 2015. On how the brain decodes vocal cues about speaker confidence. Cortex 66 (2015), 9 – 34. http://www.sciencedirect.com/science/article/pii/S0010945215000593
- Stereotype threat and executive resource depletion: examining the influence of emotion regulation. Journal of Experimental Psychology: General 137, 4 (2008), 691.
- Juanita Johnson-Bailey. 1999. The ties that bind and the shackles that separate: Race, gender, class, and color in a research process. International Journal of Qualitative Studies in Education 12, 6 (1999), 659–670.
- Aparna Joshi and Hyuntak Roh. 2009. The role of context in work team diversity research: A meta-analytic review. Academy of management journal 52, 3 (2009), 599–627.
- Cheryl R Kaiser and Carol T Miller. 2001. Stop complaining! The social costs of making attributions to discrimination. Personality and Social Psychology Bulletin 27, 2 (2001), 254–263.
- Towards increasing the compatibility of student pair programmers. In Proceedings of the 27th international conference on Software engineering. 625–626.
- Remote Pair Programming in Online CS Education: Investigating through a Gender Lens. In 2019 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). 75–85.
- K Kaushal. 2014. Social desirability bias in face to face interviews. Journal of postgraduate medicine 60, 4 (2014), 415.
- R. K. Kavitha and M. S. Irfan Ahmed. 2013. Knowledge Sharing Through Pair Programming in Learning Environments: An empirical study. Education and Information Technologies 20, 2 (Oct. 2013), 319–333.
- Ryan Scott King. 2006. Jim crow is alive and well in the 21st century: Felony disenfranchisement and the continuing struggle to silence the african-american voice. Souls 8, 2 (2006), 7–21.
- Susan E Kogler Hill and George Gant. 2000. Mentoring by Minorities for Minorities: The Organizational Communications Support Program. Review of Business 21, 1/2 (2000), 53–57. Entrepreneurship Database; ProQuest Central.
- Towards Designing Conversational Agents for Pair Programming: Accounting for Creativity Strategies and Conversational Styles. In 2020 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). 1–11.
- Trade-Offs for Substituting a Human with an Agent in a Pair Programming Context: The Good, the Bad, and the Ugly. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 243, 20 pages. https://doi.org/10.1145/3411764.3445659
- Danielle L. Jones and Scott D. Fleming. 2013. What use is a backseat driver? A qualitative investigation of pair programming. Proceedings of IEEE Symposium on Visual Languages and Human-Centric Computing, VL/HCC, 103–110.
- Christopher J Lebron. 2023. The making of black lives matter: A brief history of an idea. Oxford University Press.
- Patrick J Leman. 2015. How do groups work? Age differences in performance and the social outcomes of peer collaboration. Cognitive science 39, 4 (2015), 804–820.
- Patrick J Leman and Zoë Oldham. 2005. Do children need to learn to collaborate?: The effect of age and age differences on collaborative recall. Cognitive Development 20, 1 (2005), 33–48.
- Doug Lemov. 2010. Teach like a champion: 49 techniques that put students on the path to college (K-12). John Wiley & Sons.
- Clayton Lewis. 1982. Using the ”thinking-aloud” method in cognitive interface design. IBM T.J. Watson Research Center, Yorktown Heights, N.Y.
- Zhiqiang Liu and Dieter J Schonwetter. 2004. Teaching creativity in engineering. International Journal of Engineering Education 20, 5 (2004), 801–808.
- Stability of family interaction from ages 6 to 18. Journal of abnormal child psychology 28 (2000), 353–369.
- Kofi Lomotey. 1993. African-American principals: Bureaucrat/administrators and ethno-humanists. Urban Education 27, 4 (1993), 395–412.
- Investigating implicit gender bias and embodiment of white males in virtual reality with full body visuomotor synchrony. In Proceedings of the 2019 CHI Conference on human factors in computing systems. 1–12.
- Charles G Lord and Delia S Saenz. 1985. Memory deficits and memory surfeits: Differential cognitive consequences of tokenism for tokens and observers. Journal of personality and social psychology 49, 4 (1985), 918.
- Remote Pair Collaborations of CS Students: Leaving Women Behind?. In Proceedings of Visual Languages and Human-Centric Computing.
- Kim Man Lui and Keith CC Chan. 2006. Pair programming productivity: Novice–novice vs. expert–expert. International Journal of Human-computer studies 64, 9 (2006), 915–925.
- Antecedents and consequences of attributions to discrimination: Theoretical and empirical advances. In Advances in experimental social psychology. Vol. 34. Elsevier, 251–330.
- Christopher Mendez Alannah Oleson Claudia Hilderbrand Zoe Steine-Hanson Andrew J. Ko Margaret Burnett, Anita Sarma. 2018. Designing Technologies to Support Human Problem Solving. In Workshop at VL/HCC.
- Clair Matthew and J Denis. [n. d.]. S.(2015). Sociology of racism. International Encyclopedia of the Social & Behavioral Sciences 19, 2 ([n. d.]), 857–863.
- The effects of pair-programming on performance in an introductory programming course. ACM SIGCSE Bulletin 34, 38–42. https://doi.org/10.1145/563340.563353
- The impact of pair programming on student performance, perception and persistence. 602– 607. https://doi.org/10.1109/ICSE.2003.1201243
- Pair programming improves student retention, confidence, and program quality. Commun. ACM 49 (08 2006), 90–95. https://doi.org/10.1145/1145293
- Pair programming improves student retention, confidence, and program quality. Commun. ACM 49, 8 (2006), 90–95.
- Amade M’charek. 2013. Beyond fact or fiction: On the materiality of race in practice. Cultural anthropology 28, 3 (2013), 420–442.
- Ethnic diversity and creativity in small groups. Small group research 27, 2 (1996), 248–264.
- Power and positionality: Negotiating insider/outsider status within and across cultures. International journal of lifelong education 20, 5 (2001), 405–416.
- Donald Michie. 1989. Brute force in chess and science. ICGA Journal 12, 3 (1989), 127–143.
- Chelli A Leutschaft Miller. 2004. Expectancy bias: An exploration of practitioner effectiveness in the clinical diagnostic process. Ph. D. Dissertation. Capella University.
- Creating the ideal group: Composition effects at work. In Understanding group behavior. Psychology Press, 11–35.
- Matthias M Muller and Frank Padberg. 2004. An empirical study about the feelgood factor in pair programming. In 10th International Symposium on Software Metrics, 2004. Proceedings. IEEE, 151–158.
- MC Murphy and CM Steele. 2009. The importance of context: Understanding the effects of situational cues on perceived identity contingencies and sense of belonging. Unpublished manuscript (2009).
- The Pushback Effects of Race, Ethnicity, Gender, and Age in Code Review. Commun. ACM 65, 3 (2022), 52–57.
- Improving the CS1 experience with pair programming. ACM Sigcse Bulletin 35, 359–362. https://doi.org/10.1145/792548.612006
- Improving the CS1 experience with pair programming. ACM Sigcse Bulletin 35, 1 (2003), 359–362.
- ncwit [n. d.]. National Center for Women & Information Technology. https://www.ncwit.org/
- Gislaine N Ngounou and Nancy B Gutiérrez. 2019. The value of interracial facilitation of racial equity training. Phi Delta Kappan 100, 8 (2019), 56–61.
- Safiya Umoja Noble. 2018. Algorithms of oppression. In Algorithms of oppression. New York university press.
- John Nosek. 1998. The Case for Collaborative Programming. Commun. ACM 41 (03 1998). https://doi.org/10.1145/272287.272333
- Himani Oberai and Ila Mehrotra Anand. 2018. Unconscious bias: thinking without thinking. Human Resource Management International Digest 26, 6 (2018), 14–17.
- Critical race theory for HCI. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–16.
- A.F. Osborn. 1957. Applied Imagination: Principles and Procedures of Creative Thinking. Charles Scribner’s Sons.
- Sonia Ospina and Erica Foldy. 2009a. A critical review of race and ethnicity in the leadership literature: Surfacing context, power and the collective dimensions of leadership. The Leadership Quarterly 20, 6 (2009), 876–896. https://doi.org/10.1016/j.leaqua.2009.09.005 The Leadership Quarterly Yearly Review of Leadership.
- Sonia Ospina and Erica Foldy. 2009b. A critical review of race and ethnicity in the leadership literature: Surfacing context, power and the collective dimensions of leadership. The leadership quarterly 20, 6 (2009), 876–896.
- Sharon Oviatt and Philip Cohen. 2000. Perceptual User Interfaces: Multimodal Interfaces That Process What Comes Naturally. Commun. ACM 43, 3 (March 2000), 45–53. https://doi.org/10.1145/330534.330538
- Tyler Pace. 2008. Can an orc catch a cab in stormwind? Cybertype preference in the World of Warcraft character creation interface. In CHI’08 Extended Abstracts on Human Factors in Computing Systems. 2493–2502.
- Scott E Page. 2007. Making the difference: Applying a logic of diversity. Academy of Management Perspectives 21, 4 (2007), 6–20.
- M. Page-Jones. 1988. The Practical Guide to Structured Systems Design. Prentice Hall.
- Evidence of racial bias using immersive virtual reality: Analysis of head and hand motions during shooting decisions. IEEE Transactions on Visualization and Computer Graphics 27, 5 (2021), 2502–2512.
- Elizabeth C Pinel. 1999. Stigma consciousness: the psychological legacy of social stereotypes. Journal of personality and social psychology 76, 1 (1999), 114.
- Disengagement in pair programming: Does it matter?. In 2012 34th international conference on software engineering (ICSE). IEEE, 496–506.
- Effects of Black students’ racial identity on perceptions of White counselors varying in cultural sensitivity. Journal of Counseling Psychology 33, 1 (1986), 57.
- Social identity contingencies: how diversity cues signal threat or safety for African Americans in mainstream institutions. Journal of personality and social psychology 94, 4 (2008), 615.
- Brick by brick: iterating interventions to bridge the achievement gap with virtual peers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2971–2974.
- Mitigating bias in algorithmic hiring: Evaluating claims and practices. In Proceedings of the 2020 conference on fairness, accountability, and transparency. 469–481.
- Inioluwa Deborah Raji and Joy Buolamwini. 2019. Actionable auditing: Investigating the impact of publicly naming biased performance results of commercial ai products. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society. 429–435.
- Pandemic Programming: How COVID-19 Affects Software Developers and How Their Organizations Can Help. Empirical Software Engineering 25 (2020), 4927–4961. https://doi.org/10.1007/s10664-020-09816-2
- Vennila Ramalingam and Susan Wiedenbeck. 1998. Development and validation of scores on a computer programming self-efficacy scale and group analyses of novice programmer self-efficacy. Journal of Educational Computing Research 19, 4 (1998), 367–381.
- Diversity in leadership: Race in leader-member exchanges. Leadership & Organization Development Journal 37, 6 (2016), 750–773.
- Joy Lisi Rankin. 2023. Learning to code isn’t enough. https://www.technologyreview.com/2023/04/20/1071291/learn-to-code-legacy-new-projects-education/amp/
- Yolanda A Rankin and India Irish. 2020. A seat at the table: Black feminist thought as a critical framework for inclusive game design. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (2020), 1–26.
- Yolanda A Rankin and Jakita O Thomas. 2019. Straighten up and fly right: Rethinking intersectionality in HCI research. Interactions 26, 6 (2019), 64–68.
- Norma M Riccucci. 2021. Managing diversity in public sector workforces. Routledge.
- Peter Robe and Sandeep Kaur Kuttal. 2022. Designing PairBuddy—A Conversational Agent for Pair Programming. ACM Trans. Comput.-Hum. Interact. 29, 4, Article 34 (may 2022), 44 pages. https://doi.org/10.1145/3498326
- Loriann Roberson and Caryn J Block. 2001. 6. Racioethnicity and job performance: A review and critique of theoretical perspectives on the causes of group differences. Research in organizational behavior 23 (2001), 247–325.
- Stereotype threat and feedback seeking in the workplace. Journal of Vocational Behavior 62, 1 (2003), 176–188.
- Wendy D Roth. 2016. The multiple dimensions of race. Ethnic and Racial Studies 39, 8 (2016), 1310–1338.
- Observations of Pair Programming: Variations in Collaboration Across Demographic Groups. 90–95. https://doi.org/10.1145/2839509.2844558
- Observations of pair programming: Variations in collaboration across demographic groups. In Proceedings of the 47th ACM technical symposium on computing science education. 90–95.
- Increasing validity through replication: an illustrative TDD case. Software Quality Journal 28 (2020), 371–395.
- R. E. Santos and P. Ralph. 2022. A Grounded Theory of Coordination in Remote-First and Hybrid Software Teams. In 44th IEEE/ACM International Conference on Software Engineering (ICSE 2022). 25–35.
- When managers decide not to decide autocratically: An investigation of leader–member exchange and decision influence. Journal of applied psychology 71, 4 (1986), 579.
- Intersectional HCI: Engaging identity through gender, race, and class. In Proceedings of the 2017 CHI conference on human factors in computing systems. 5412–5427.
- Doris Schroeder and Eugenijus Gefenas. 2009. Vulnerability: too vague and too broad? Cambridge Quarterly of Healthcare Ethics 18, 2 (2009), 113–121.
- Transmission of Facial Expressions of Emotion Co-Evolved with Their Efficient Decoding in the Brain: Behavioral and Brain Evidence. PLOS ONE 4, 5 (05 2009), 1–16. https://doi.org/10.1371/journal.pone.0005625
- C. B. Seaman. 1999. ”Qualitative Methods in Empirical Studies of Software Engineering”. In IEEE Transactions on Software Engineering, Vol. 25. 557–572.
- Young-Ho Seo and Jong-Hoon Kim. 2016. Analyzing the Effects of Coding Education through Pair Programming for the Computational Thinking and Creativity of Elementary School Students. Indian Journal of Science and Technology 9 (12 2016). https://doi.org/10.17485/ijst/2016/v9i46/107837
- Amanda K. Sesko and Monica Biernat. 2010. Prototypes of race and gender: The invisibility of Black women. Journal of Experimental Social Psychology 46, 2 (2010), 356–360. https://doi.org/10.1016/j.jesp.2009.10.016
- J Nicole Shelton. 2003. Interpersonal concerns in social encounters between majority and minority group members. Group Processes & Intergroup Relations 6, 2 (2003), 171–185.
- J Nicole Shelton and Jennifer A Richeson. 2006. Interracial interactions: A relational approach. Advances in experimental social psychology 38 (2006), 121–181.
- Sugar-coaters and straight talkers: communicating about developmental delays in primary care. Pediatrics 124, 4 (2009), e705–e713.
- Beth Simon and Brian Hanks. 2008. First-year students’ impressions of pair programming in CS1. Journal on Educational Resources in Computing (JERIC) 7, 4 (2008), 1–28.
- What’s race got to do with it? Engaging in race in HCI. In Extended abstracts of the 2020 CHI conference on human factors in computing systems. 1–8.
- Daryl G Smith and Natalie B Schonfeld. 2000. The benefits of diversity what the research tells us. About campus 5, 5 (2000), 16–23.
- Daniel G Solórzano and Tara J Yosso. 2002. Critical race methodology: Counter-storytelling as an analytical framework for education research. Qualitative inquiry 8, 1 (2002), 23–44.
- “I Would Like to Design”: Black Girls Analyzing and Ideating Fair and Accountable AI. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–14.
- Samuel R Sommers. 2006. On racial diversity and group decision making: identifying multiple effects of racial composition on jury deliberations. Journal of personality and social psychology 90, 4 (2006), 597.
- Ian Sommerville. 2010. Software Engineering (9 ed.). Addison-Wesley, Harlow, England.
- Stereotype threat and women’s math performance. Journal of experimental social psychology 35, 1 (1999), 4–28.
- Anterior Temporal Lobe Tracks the Formation of Prejudice. Journal of Cognitive Neuroscience 29, 3 (03 2017), 530–544. https://doi.org/10.1162/jocn_a_01056 arXiv:https://direct.mit.edu/jocn/article-pdf/29/3/530/1952357/jocn_a_01056.pdf
- Kurt D Squire. 2008. Video games and education: Designing learning systems for an interactive age. Educational technology (2008), 17–26.
- Claude M Steele. 1997. A threat in the air: How stereotypes shape intellectual identity and performance. American psychologist 52, 6 (1997), 613.
- Claude M Steele. 2011. Whistling Vivaldi: How stereotypes affect us and what we can do. WW Norton & Company.
- Contending with group image: The psychology of stereotype and social identity threat. In Advances in experimental social psychology. Vol. 34. Elsevier, 379–440.
- Dannelle D Stevens and Antonia J Levi. 2023. Introduction to rubrics: An assessment tool to save grading time, convey effective feedback, and promote student learning. Routledge.
- The effectiveness of pair programming: Software professionals’ perceptions. IEEE Software 33, 4 (2015), 72–79.
- Exploring communication and sharing between extended families. International Journal of Human-Computer Studies 67, 2 (2009), 128–138.
- Code warriors and code-a-phobes: a study in attitude and pair programming. ACM SIGCSE Bulletin 35, 1 (2003), 363–367.
- Ross A Thompson. 2006. The development of the person: social understanding, relationships, conscience, self. (2006).
- Body Swapping with a Black Person Boosts Empathy: Using Virtual Reality to Embody Another. Quarterly Journal of Experimental Psychology (2006) 74, 12 (2021), 2057–2074. https://doi.org/10.1177/17470218211024826
- Developing the computer programming self-efficacy scale for computer literacy education. Journal of Educational Computing Research 56, 8 (2019), 1345–1360.
- An Empirical Study on Factors related to Distributed Pair Programming. (04 2019). https://www.learntechlib.org/p/208576
- Tammy VanDeGrift. 2004. Coupling pair programming and writing: learning about students’ perceptions and processes. In Proceedings of the 35th SIGCSE technical symposium on Computer science education. 2–6.
- Hippocampal brain-network coordination during volitional exploratory behavior enhances learning. Nature neuroscience 14, 1 (2011), 115–120.
- Tony Wagner and Robert A Compton. 2012. Creating innovators: The making of young people who will change the world. Simon and Schuster.
- Gregory M Walton and Geoffrey L Cohen. 2007. A question of belonging: race, social fit, and achievement. Journal of personality and social psychology 92, 1 (2007), 82.
- Alicia Nicki Washington. 2020. When twice as good isn’t enough: The case for cultural competence in computing. In Proceedings of the 51st ACM technical symposium on computer science education. 213–219.
- David T Wellman. 1993. Portraits of white racism. Cambridge University Press.
- Linda Werner and Jill Denning. 2009. Pair programming in middle school: What does it look like? Journal of Research on Technology in Education 42, 1 (2009), 29–49.
- Pair-Programming Helps Female Computer Science Students. J. Educ. Resour. Comput. 4, 1 (March 2004), 4–es. https://doi.org/10.1145/1060071.1060075
- Pair-programming helps female computer science students. Journal on Educational Resources in Computing (JERIC) 4, 1 (2004), 4–es.
- Laurie Williams and Robert Kessler. 2002. Pair Programming Illuminated. Addison-Wesley Longman Publishing Co., Inc., USA.
- In Support of Pair Programming in the Introductory Computer Science Course. Computer Science Education 12, 3 (2002), 197–212. https://doi.org/10.1076/csed.12.3.197.8618
- In support of pair programming in the introductory computer science course. Computer Science Education 12, 3 (2002), 197–212.
- Laurie A. Williams and Robert R. Kessler. 2000. All I Really Need to Know about Pair Programming I Learned in Kindergarten. Commun. ACM 43, 5 (May 2000), 108–114. https://doi.org/10.1145/332833.332848
- Amy Louise Wood. 2011. Lynching and spectacle: Witnessing racial violence in America, 1890-1940. Univ of North Carolina Press.
- Stuart Wray. 2009. How pair programming really works. IEEE software 27, 1 (2009), 50–55.
- Dvora Yanow. Year. Constructing Race and Ethnicity in America: Category-making in Public Policy and Administration (1st ed.). Taylor & Francis.
- In their own words: Gender differences in student perceptions of pair programming. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education. 1053–1059.
- Erman Yukselturk and Serhat Altiok. 2017. An investigation of the effects of programming with Scratch on the preservice IT teachers’ self-efficacy perceptions and attitudes towards computer programming. British Journal of Educational Technology 48, 3 (2017), 789–801.
- Yong Zhao. 2012. World class learners: Educating creative and entrepreneurial students. Corwin Press.
- The impact of social factors on pair programming in a primary school. Computers in Human Behavior 64 (2016), 423–431.
- Investigating the period of switching roles in pair programming in a primary school. Journal of Educational Technology & Society 20, 3 (2017), 220–233.
- Franz Zieris and Lutz Prechelt. 2020. Explaining pair programming session dynamics from knowledge gaps. In Proc. 42nd Int’l. Conf. on Software Engineering (ICSE’20).