Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Not Just Training, Also Testing: High School Youths' Perspective-Taking through Peer Testing Machine Learning-Powered Applications (2311.12733v2)

Published 21 Nov 2023 in cs.CY and cs.HC

Abstract: Most attention in K-12 artificial intelligence and machine learning (AI/ML) education has been given to having youths train models, with much less attention to the equally important testing of models when creating machine learning applications. Testing ML applications allows for the evaluation of models against predictions and can help creators of applications identify and address failure and edge cases that could negatively impact user experiences. We investigate how testing each other's projects supported youths to take perspective about functionality, performance, and potential issues in their own projects. We analyzed testing worksheets, audio and video recordings collected during a two week workshop in which 11 high school youths created physical computing projects that included (audio, pose, and image) ML classifiers. We found that through peer-testing youths reflected on the size of their training datasets, the diversity of their training data, the design of their classes and the contexts in which they produced training data. We discuss future directions for research on peer-testing in AI/ML education and current limitations for these kinds of activities.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (44)
  1. Edith Ackermann. 2012. Perspective-taking and object construction: Two keys to learning. In Constructionism in practice. Routledge, 25–35.
  2. Towards an AI-Infused Interdisciplinary Curriculum for Middle-Grade Classrooms. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 12681–12688.
  3. Virginia Braun and Victoria Clarke. 2012. Thematic analysis. American Psychological Association.
  4. Leah Buechley. 2006. A construction kit for electronic textiles. In 2006 10th IEEE international symposium on wearable computers. Ieee, 83–90.
  5. Debra Burhans and Karthik Dantu. 2017. ARTY: Fueling creativity through art, robotics and technology for youth. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 31.
  6. Teachable machine: Approachable Web-based tool for exploring machine learning classification. In Extended abstracts of the 2020 CHI conference on human factors in computing systems. 1–8.
  7. Preparing Children To Be Conscientious Consumers And Designers Of AI Technologies. Computational Thinking Education in K-12: Artificial Intelligence Literacy and Physical Computing (2022).
  8. Stefania Druga and Amy J Ko. 2021. How do children’s perceptions of machine intelligence change when training and coding smart programs?. In Interaction design and children. 49–61.
  9. The landscape of teaching resources for ai education. In Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 1. 96–102.
  10. Exploring machine teaching with children. In 2021 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). IEEE, 1–11.
  11. Rebecca Fiebrink. 2019. Machine learning education for artists, musicians, and other creative practitioners. ACM Transactions on Computing Education (TOCE) 19, 4 (2019), 1–32.
  12. Can children understand machine learning concepts? The effect of uncovering black boxes. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–11.
  13. Stitching the Loop with Electronic Textiles: Promoting Equity in High School Students’ Competencies and Perceptions of Computer Science. In Proceedings of the 50th ACM technical symposium on computer science education. 1176–1182.
  14. Jennifer Kahn. 2022. Learning at the intersection of self and society: The family geobiography as a context for data science education. In Situating Data Science. Routledge, 57–80.
  15. High school students exploring machine learning and its societal implications: Opportunities and challenges. International Journal of Child-Computer Interaction (2022), 100539.
  16. Robert Kegan. 1982. The evolving self: Problem and process in human development. Harvard University Press.
  17. Pat Langley. 1988. Machine learning as an experimental science. Machine Learning 3, 1 (1988), 5–8.
  18. Irene Lee and Beatriz Perret. 2022. Preparing High School Teachers to Integrate AI Methods into STEM Classrooms. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 12783–12791.
  19. Duri Long and Brian Magerko. 2020. What is AI literacy? Competencies and design considerations. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–16.
  20. Learning sciences for computing education. Cambridge University Press Cambridge.
  21. Teaching machine learning in school: A systematic mapping of the state of the art. Informatics in Education 19, 2 (2020), 283–321.
  22. Reliability and inter-rater reliability in qualitative research: Norms and guidelines for CSCW and HCI practice. Proceedings of the ACM on human-computer interaction 3, CSCW (2019), 1–23.
  23. Auditing algorithms: Understanding algorithmic systems from the outside in. Foundations and Trends® in Human–Computer Interaction 14, 4 (2021), 272–344.
  24. Using digital story writing as a pedagogy to develop AI literacy among primary students. Computers and Education: Artificial Intelligence 3 (2022), 100054.
  25. Marcelo Fernando Rauber and Christiane Gresse von Wangenheim. 2022. Assessing the learning of machine learning in K-12: A ten-year systematic mapping. Informatics in Education 22, 2 (2022), 295–328.
  26. Jessica Roberts and Leilah Lyons. 2022. Examining spontaneous perspective taking and fluid self-to-data relationships in informal open-ended data exploration. In Situating Data Science. Routledge, 32–56.
  27. A systematic review of teaching and learning machine learning in K-12 education. Education and Information Technologies 28, 5 (2023), 5967–5997.
  28. Rob Schapire. 2014. What is machine learning? https://www.cs.princeton.edu/courses/archive/spring14/cos511/scribe_notes/0204.pdf
  29. How machine learning impacts the undergraduate computing curriculum. Commun. ACM 61, 11 (2018), 27–29.
  30. R Benjamin Shapiro and Mike Tissenbaum. 2019. New programming paradigms. In The Cambridge Handbook of Computing Education Research. Cambridge University Press, 606–636.
  31. Amanda Strawhacker and Marina U Bers. 2015. “I want my robot to look for food”: Comparing Kindergartner’s programming comprehension using tangible, graphic, and hybrid user interfaces. International Journal of Technology and Design Education 25 (2015), 293–319.
  32. CT 2.0. In Proceedings of the 21st Koli Calling International Conference on Computing Education Research. 1–8.
  33. Josh Tenenberg. 2019. Qualitative methods for computing education. The Cambridge handbook of computing education research (2019), 173–207.
  34. David S Touretzky and Christina Gardner-McCune. 2022. Artificial intelligence thinking in k-12. Computational Thinking Education in K-12: Artificial Intelligence Literacy and Physical Computing (2022), 153–180.
  35. Co-ML: Collaborative Machine Learning Model Building for Developing Dataset Design Practices. ACM Transactions on Computing Education (TOCE) (2024).
  36. Collaborative Machine Learning Model Building with Families Using Co-ML. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference. 40–51.
  37. Learning machine learning with very young children: Who is teaching whom? International journal of child-computer interaction 25 (2020), 100182.
  38. Machine learning for middle schoolers: Learning through data-driven design. International Journal of Child-Computer Interaction 29 (2021), 100281.
  39. Learn to machine learn: designing a game based approach for teaching machine learning to primary and secondary education students. In Interaction design and children. 593–598.
  40. Uri Wilensky and Kenneth Reisman. 2006. Thinking like a wolf, a sheep, or a firefly: Learning biology through constructing and testing computational theories—an embodied modeling approach. Cognition and instruction 24, 2 (2006), 171–209.
  41. Teacher perspectives on how to train your robot: A middle school AI and ethics curriculum. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 15678–15686.
  42. Machine learning testing: Survey, landscapes and horizons. IEEE Transactions on Software Engineering 48, 1 (2020), 1–36.
  43. Youth making machine learning models for gesture-controlled interactive media. In Proceedings of the interaction design and children conference. 63–74.
  44. Youth learning machine learning through building models of athletic moves. In Proceedings of the 18th ACM international conference on interaction design and children. 121–132.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)
  1. L. Morales-Navarro (2 papers)
  2. M. Shah (2 papers)
  3. Y. B. Kafai (2 papers)
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now