Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
102 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Youth as Peer Auditors: Engaging Teenagers with Algorithm Auditing of Machine Learning Applications (2404.05874v3)

Published 8 Apr 2024 in cs.HC and cs.CY

Abstract: As artificial intelligence/machine learning (AI/ML) applications become more pervasive in youth lives, supporting them to interact, design, and evaluate applications is crucial. This paper positions youth as auditors of their peers' ML-powered applications to better understand algorithmic systems' opaque inner workings and external impacts. In a two-week workshop, 13 youth (ages 14-15) designed and audited ML-powered applications. We analyzed pre/post clinical interviews in which youth were presented with auditing tasks. The analyses show that after the workshop all youth identified algorithmic biases and inferred dataset and model design issues. Youth also discussed algorithmic justice issues and ML model improvements. Furthermore, youth reflected that auditing provided them new perspectives on model functionality and ideas to improve their own models. This work contributes (1) a conceptualization of algorithm auditing for youth; and (2) empirical evidence of the potential benefits of auditing. We discuss potential uses of algorithm auditing in learning and child-computer interaction research.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (68)
  1. Edith Ackermann. 2012. Perspective-taking and object construction: Two keys to learning. In Constructionism in practice. Routledge,  , 25–35.
  2. The dynamic effects of tax audits. Review of Economics and Statistics 105, 3 (2023), 545–561.
  3. Constructionism, ethics, and creativity: Developing primary and middle school artificial intelligence education. In International workshop on education in artificial intelligence k-12 (eduai’19), Vol. 2.  ,  , 1–4.
  4. Jack Bandy. 2021. Problematic machine behavior: A systematic literature review of algorithm audits. Proceedings of the acm on human-computer interaction 5, CSCW1 (2021), 1–34.
  5. Tax audits as scarecrows: Evidence from a large-scale field experiment. American Economic Journal: Economic Policy 15, 1 (2023), 110–153.
  6. Abeba Birhane. 2021. Algorithmic injustice: a relational ethics approach. Patterns 2, 2 (2021),  .
  7. Virginia Braun and Victoria Clarke. 2012. Thematic analysis. American Psychological Association,  .
  8. Joy Buolamwini. 2022. Facing the Coded Gaze with Evocative Audits and Algorithmic Audits. Ph. D. Dissertation. Massachusetts Institute of Technology.
  9. Debra Burhans and Karthik Dantu. 2017. ARTY: Fueling creativity through art, robotics and technology for youth. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 31.  ,  ,  .
  10. Exploring the concept of fairness in everyday, imaginary and robot scenarios: a cross-cultural study with children in Japan and Uganda. In Proceedings of the 20th Annual ACM Interaction Design and Children Conference.  ,  , 532–536.
  11. Merijke Coenraad. 2022. “That’s what techquity is”: youth perceptions of technological and algorithmic bias. Information and Learning Sciences 123, 7/8 (2022), 500–525.
  12. Dall· e mini. HuggingFace. com. https://huggingface. co/spaces/dallemini/dalle-mini (accessed Sep. 29, 2022)  ,   (2021),  .
  13. Toward User-Driven Algorithm Auditing: Investigating users’ strategies for uncovering harmful algorithmic behavior. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems.  ,  , 1–19.
  14. ARtonomous: Introducing middle school students to reinforcement learning through virtual robotics. In Interaction Design and Children.  ,  , 430–441.
  15. Giggle gauge: a self-report instrument for evaluating children’s engagement with technology. In Proceedings of the Interaction Design and Children Conference.  ,  , 614–623.
  16. Computational empowerment: participatory design in education. CoDesign 16, 1 (2020), 66–80.
  17. Andrea A disessa. 2007. An interactional analysis of clinical interviewing. Cognition and instruction 25, 4 (2007), 523–565.
  18. ” It’s your private information. it’s your life.” young people’s views of personal data use by online technologies. In Proceedings of the interaction design and children conference.  ,  , 121–134.
  19. Stefania Druga and Amy J Ko. 2021. How do children’s perceptions of machine intelligence change when training and coding smart programs?. In Interaction design and children.  ,  , 49–61.
  20. Allison Druin. 2002. The role of children in the design of new technology. Behaviour and information technology 21, 1 (2002), 1–25.
  21. Exploring machine teaching with children. In 2021 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). IEEE,  ,  , 1–11.
  22. Methods and techniques for involving children in the design of new technology for children. Foundations and Trends® in Human–Computer Interaction 6, 2 (2013), 85–166.
  23. Rebecca Fiebrink. 2019. Machine learning education for artists, musicians, and other creative practitioners. ACM Transactions on Computing Education (TOCE) 19, 4 (2019), 1–32.
  24. Adele Goldberg. 1979. Educational uses of a dynabook. Computers & Education 3, 4 (1979), 247–266.
  25. Idit Harel. 1991. Children designers: Interdisciplinary constructions for learning and knowing mathematics in a computer-rich school. Ablex Publishing,  .
  26. Can children understand machine learning concepts? The effect of uncovering black boxes. In Proceedings of the 2019 CHI conference on human factors in computing systems.  ,  , 1–11.
  27. Designing constructionist futures: The art, theory, and practice of learning designs. MIT Press,  .
  28. Characterizing children’s conceptual knowledge and computational practices in a critical machine learning educational program. International Journal of Child-Computer Interaction 34 (2022), 100541.
  29. Yasmin Kafai and Idit Harel. 1991a. Learning through design and teaching: Exploring social and collaborative aspects of constructionism. Constructionism  ,   (1991), 85–106.
  30. Yasmin B Kafai. 1998. Children as designers, testers, and evaluators of educational software. In The design of children’s technology.  ,  , 123–145.
  31. Yasmin B Kafai. 2012. Minds in play: Computer game design as a context for children’s learning. Routledge,  .
  32. Yasmin B. Kafai and Idit Harel. 1991b. Children’s learning through consulting: When mathematical ideas, programming knowledge, instructional design, and playful discourse are intertwined. In Constructionism. Ablex Publishing,  , 85–110.
  33. High school students exploring machine learning and its societal implications: Opportunities and challenges. International Journal of Child-Computer Interaction  ,   (2022),  .
  34. Alan C Kay. 1996. The early history of Smalltalk. In History of programming languages—II.  ,  , 511–598.
  35. End-User Audits: A System Empowering Communities to Lead Large-Scale Investigations of Harmful Algorithmic Behavior. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (2022), 1–34.
  36. Sociotechnical Audits: Broadening the Algorithm Auditing Lens to Investigate Targeted Advertising. Proceedings of the ACM on Human-Computer Interaction 7, CSCW2 (2023), 1–37.
  37. When Children Chat with Machine Translated Text: Problems, Possibilities, Potential. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference.  ,  , 198–209.
  38. Victor R Lee and Deborah A Fields. 2017. A rubric for describing competences in the areas of circuitry, computation, and crafting after a course using e-textiles. The International Journal of Information and Learning Technology 34, 5 (2017), 372–384.
  39. Child–Computer Interaction: From a systematic review towards an integrated understanding of interaction design methods for children. International Journal of Child-Computer Interaction 32 (2022), 100398.
  40. Duri Long and Brian Magerko. 2020. What is AI literacy? Competencies and design considerations. In Proceedings of the 2020 CHI conference on human factors in computing systems.  ,  , 1–16.
  41. Programming by choice: urban youth learning programming with scratch. In Proceedings of the 39th SIGCSE technical symposium on Computer science education.  ,  , 367–371.
  42. Giulia Mascagni. 2018. From the lab to the field: A review of tax experiments. Journal of Economic Surveys 32, 2 (2018), 273–301.
  43. Reliability and inter-rater reliability in qualitative research: Norms and guidelines for CSCW and HCI practice. Proceedings of the ACM on human-computer interaction 3, CSCW (2019), 1–23.
  44. An image of society: Gender and racial representation and impact in image search results for occupations. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1–23.
  45. Auditing algorithms: Understanding algorithmic systems from the outside in. Foundations and Trends® in Human–Computer Interaction 14, 4 (2021), 272–344.
  46. Luis Morales-Navarro and Yasmin B Kafai. 2023. Conceptualizing Approaches to Critical Computing Education: Inquiry, Design, and Reimagination. In Past, Present and Future of Computing Education Research: A Global Perspective. Springer,  , 521–538.
  47. Not Just Training, Also Testing: High School Youths’ Perspective-Taking through Peer Testing Machine Learning-Powered Applications. In Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1.  ,  ,  .
  48. Auditing partisan audience bias within google search. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 1–22.
  49. Scaffolding Children’s Sensemaking around Algorithmic Fairness. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference.  ,  , 137–149.
  50. Funds of Knowledge used by Adolescents of Color in Scaffolded Sensemaking around Algorithmic Fairness. In Proceedings of the 2023 ACM Conference on International Computing Education Research - Volume 1 (Chicago, IL, USA) (ICER ’23). Association for Computing Machinery, New York, NY, USA, 191–205. https://doi.org/10.1145/3568813.3600110
  51. Mike Scaife and Yvonne Rogers. 1999. Kids as informants: Telling us what we didn’t know or confirming what we knew already. The design of children’s technology  ,   (1999), 27–50.
  52. Everyday algorithm auditing: Understanding the power of everyday users in surfacing harmful algorithmic behaviors. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1–29.
  53. Some assembly required: How scientific explanations are constructed during clinical interviews. Journal of Research in Science Teaching 49, 2 (2012), 166–198.
  54. History of logo. Proceedings of the ACM on Programming Languages 4, HOPL (2020), 1–66.
  55. “I Would Like to Design”: Black Girls Analyzing and Ideating Fair and Accountable AI. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems.  ,  , 1–14.
  56. The Potential of Diverse Youth as Stakeholders in Identifying and Mitigating Algorithmic Bias for a Future of Fairer AI. Proceedings of the ACM on Human-Computer Interaction 7, CSCW2 (2023), 1–27.
  57. Co-ML: Collaborative Machine Learning Model Building for Developing Dataset Design Practices. ACM Transactions on Computing Education (TOCE)  ,   (2024),  .
  58. Collaborative Machine Learning Model Building with Families Using Co-ML. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference.  ,  , 40–51.
  59. Sepehr Vakil and Maxine McKinney de Royston. 2022. Youth as philosophers of technology. Mind, Culture, and Activity 29, 4 (2022), 336–355.
  60. Emerging technologies in K–12 education: A future HCI research agenda. ACM Transactions on Computer-Human Interaction 30, 3 (2023), 1–40.
  61. Learning machine learning with very young children: Who is teaching whom? International journal of child-computer interaction 25 (2020), 100182.
  62. Machine learning for middle schoolers: Learning through data-driven design. International Journal of Child-Computer Interaction 29 (2021), 100281.
  63. Learn to machine learn: designing a game based approach for teaching machine learning to primary and secondary education students. In Interaction design and children.  ,  , 593–598.
  64. Liberatory Computing Education for African American Students. In 2022 IEEE Conference on Research in Equitable and Sustained Participation in Engineering, Computing, and Technology (RESPECT). IEEE,  ,  , 85–89.
  65. Co-design Tensions Between Parents, Children, and Researchers Regarding Mobile Health Technology Design Needs and Decisions: Case Study. JMIR Formative Research 7, 1 (2023), e41726.
  66. Youth making machine learning models for gesture-controlled interactive media. In Proceedings of the interaction design and children conference.  ,  , 63–74.
  67. Youth learning machine learning through building models of athletic moves. In Proceedings of the 18th ACM international conference on interaction design and children.  ,  , 121–132.
  68. Leveraging tangible interfaces in primary school math: Pilot testing of the Owlet math program. International Journal of Child-Computer Interaction 27 (2021), 100222.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Luis Morales-Navarro (17 papers)
  2. Yasmin B. Kafai (14 papers)
  3. Vedya Konda (1 paper)
  4. Danaë Metaxa (7 papers)