Creator Hearts: Investigating the Impact Positive Signals from YouTube Creators in Shaping Comment Section Behavior (2404.03612v1)
Abstract: Much of the research in online moderation focuses on punitive actions. However, emerging research has shown that positive reinforcement is effective at encouraging desirable behavior on online platforms. We extend this research by studying the "creator heart" feature on YouTube, quantifying their primary effects on comments that receive hearts and on videos where hearts have been given. We find that creator hearts increased the visibility of comments, and increased the amount of positive engagement they received from other users. We also find that the presence of a creator hearted comment soon after a video is published can incentivize viewers to comment, increasing the total engagement with the video over time. We discuss the potential for creators to use hearts to shape behavior in their communities by highlighting, rewarding, and incentivizing desirable behaviors from users. We discuss avenues for extending our study to understanding positive signals from moderators on other platforms.
- [n. d.]. Post & interact with comments - Computer - YouTube Help. https://support.google.com/youtube/answer/6000964/#zippy=%5C%2Ccomment-previews-faq
- PyMC: a modern, and comprehensive probabilistic programming framework in Python. PeerJ Computer Science 9 (Sept. 2023), e1516. https://doi.org/10.7717/peerj-cs.1516
- B. Thomas Adler and Luca De Alfaro. 2007. A content-driven reputation system for the wikipedia. In Proceedings of the 16th international conference on World Wide Web. ACM, Banff Alberta Canada, 261–270. https://doi.org/10.1145/1242572.1242608
- Steering user behavior with badges. In Proceedings of the 22nd international conference on World Wide Web. ACM, Rio de Janeiro Brazil, 95–106. https://doi.org/10.1145/2488388.2488398
- Engaging with massive online courses. In Proceedings of the 23rd international conference on World wide web. 687–698.
- Shaljan Areepattamannil. 2010. Parenting practices, parenting style, and children’s school achievement. Psychological Studies 55 (2010), 283–289. Publisher: Springer.
- Michael B Armstrong and Richard N Landers. 2018. Gamification of employee training and development. International Journal of Training and Development 22, 2 (2018), 162–169. Publisher: Wiley Online Library.
- Harmonizing the Cacophony with MIC: An Affordance-aware Framework for Platform Moderation. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (2022), 1–22.
- Conversations gone alright: Quantifying and predicting prosocial outcomes in online conversations. In Proceedings of the Web Conference 2021. 1134–1145.
- Embedding Societal Values into Social Media Algorithms. Journal of Online Trust and Safety 2, 1 (2023).
- Employee recognition and performance: A field experiment. Management Science 62, 11 (2016), 3085–3099. Publisher: INFORMS.
- The effect of YouTube comment interaction on video engagement: focusing on interactivity centralization and creators’ interactivity. Online Information Review 47, 6 (2023), 1083–1097.
- Crossmod: A cross-community learning-based system to assist reddit moderators. Proceedings of the ACM on human-computer interaction 3, CSCW (2019), 1–30.
- Quarantined! Examining the effects of a community-wide moderation intervention on Reddit. ACM Transactions on Computer-Human Interaction (TOCHI) 29, 4 (2022), 1–26.
- You Can’t Stay Here: The Efficacy of Reddit’s 2015 Ban Examined Through Hate Speech. In Proceedings of the ACM on Human-Computer Interaction, Vol. 1. 1–22. https://doi.org/10.1145/3134666
- ConvEx: A Visual Conversation Exploration System for Discord Moderators. Proceedings of the ACM on Human-Computer Interaction 7, CSCW2 (2023), 1–30.
- Don Dinkmeyer and Gary D McKay. 1989. The parent’s handbook: Systematic training for effective parenting. ERIC.
- Ilana Dubovi and Iris Tabak. 2020. An empirical analysis of knowledge co-construction in YouTube comments. Computers & Education 156 (Oct. 2020), 103939. https://doi.org/10.1016/j.compedu.2020.103939
- C. B. Ferster and B. F. Skinner. 1957. Schedules of reinforcement. Appleton-Century-Crofts, East Norwalk. https://doi.org/10.1037/10627-000
- Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media. Yale University Press.
- James Grimmelmann. 2015. The virtues of moderation. Yale JL & Tech. 17 (2015), 42.
- Does gamification work?–a literature review of empirical studies on gamification. In 2014 47th Hawaii international conference on system sciences. IEEE, 3025–3034.
- Understanding and interpreting confidence and credible intervals around effect estimates. Brazilian journal of physical therapy 23, 4 (2019), 290–301.
- Harold Jeffreys. 1946. An invariant form for the prior probability in estimation problems. Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences 186, 1007 (1946), 453–461.
- Human-machine collaboration for content regulation: The case of reddit automoderator. ACM Transactions on Computer-Human Interaction (TOCHI) 26, 5 (2019), 1–35.
- A Just and Comprehensive Strategy for Using NLP to Address Online Abuse. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 3658–3666.
- Using Longitudinal Social Media Analysis to Understand the Effects of Early College Alcohol Use. Proceedings of the International AAAI Conference on Web and Social Media 12, 1 (June 2018). https://doi.org/10.1609/icwsm.v12i1.15012 Number: 1.
- Technological frames and user innovation: Exploring technological change in community moderation teams. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–23.
- Regulating behavior in online communities. Building successful online communities: Evidence-based social design 1 (2012), 4–2.
- “Positive reinforcement helps breed positive behavior”: Moderator Perspectives on Encouraging Desirable Behavior. Proceedings of the ACM on Human-Computer Interaction 8, CSCW2 (2024).
- Courtney Lessard. 2016. New tools to shape conversations in your comments section. https://blog.youtube/news-and-events/new-tools-to-shape-conversations-in/
- Measuring the monetary value of online volunteer work. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 16. 596–606.
- J Nathan Matias. 2019. Preventing harassment and increasing group participation through social norms in 2,190 online science discussions. Proceedings of the National Academy of Sciences 116, 20 (2019), 9785–9789.
- Richard McElreath. 2018. Statistical rethinking: A Bayesian course with examples in R and Stan. Chapman and Hall/CRC.
- Enhancing workplace motivation through gamification: Transferrable lessons from pedagogy. The International Journal of Management Education 14, 3 (2016), 327–335. Publisher: Elsevier.
- Sarah T Roberts. 2016. Commercial content moderation: Digital laborers’ dirty work. (2016).
- The community is where the rapport is – on sense and structure in the youtube community. In Proceedings of the fourth international conference on Communities and technologies (C&T ’09). Association for Computing Machinery, New York, NY, USA, 41–50. https://doi.org/10.1145/1556460.1556467
- Donald B Rubin and Elizabeth A Stuart. 2006. Affinely invariant matching methods with discriminant mixtures of proportional ellipsoidally symmetric distributions. (2006).
- Koustuv Saha and Amit Sharma. 2020. Causal Factors of Effective Psychosocial Outcomes in Online Mental Health Communities. Proceedings of the International AAAI Conference on Web and Social Media 14 (May 2020), 590–601. https://doi.org/10.1609/icwsm.v14i1.7326
- How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction. Computers in human behavior 69 (2017), 371–380. Publisher: Elsevier.
- Online Harassment: Assessing Harms and Remedies. Social Media+ Society 9, 1 (2023), 20563051231157297.
- Leave a Comment! An In-Depth Analysis of User Comments on YouTube. ([n. d.]).
- Shaping Pro and Anti-Social Behavior on Twitch Through Moderation and Example-Setting. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, Portland Oregon USA, 111–125. https://doi.org/10.1145/2998181.2998277
- How useful are your comments? analyzing and predicting youtube comments and comment ratings. In Proceedings of the 19th international conference on World wide web (WWW ’10). Association for Computing Machinery, New York, NY, USA, 891–900. https://doi.org/10.1145/1772690.1772781
- Ellen Simpson and Bryan Semaan. 2021. For You, or For” You”? Everyday LGBTQ+ Encounters with TikTok. Proceedings of the ACM on human-computer interaction 4, CSCW3 (2021), 1–34.
- B. F. Skinner. 1963. Operant behavior. American Psychologist 18, 8 (1963), 503–515. https://doi.org/10.1037/h0045185 Place: US Publisher: American Psychological Association.
- Burrhus Frederic Skinner. 1965. Science and human behavior. Number 92904. Simon and Schuster.
- Burrhus Frederic Skinner. 1989. Recent issues in the analysis of behavior. Prentice Hall.
- Impact of parenting practices on adolescent achievement: Authoritative parenting, school involvement, and encouragement to succeed. Child development 63, 5 (1992), 1266–1281. Publisher: Wiley Online Library.
- “It’s common and a part of being a content creator”: Understanding How Creators Experience and Cope with Hate and Harassment Online. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (¡conf-loc¿, ¡city¿New Orleans¡/city¿, ¡state¿LA¡/state¿, ¡country¿USA¡/country¿, ¡/conf-loc¿) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 121, 15 pages. https://doi.org/10.1145/3491102.3501879
- Yixue Wang and Nicholas Diakopoulos. 2021. Highlighting High-quality Content as a Moderation Strategy: The Role of New York Times Picks in Comment Quality and Engagement. In ACM Transactions on Social Computing, Vol. 4. 1–24. https://doi.org/10.1145/3484245
- Sensemaking, support, safety, retribution, transformation: A restorative justice approach to understanding adolescents’ needs for addressing online harm. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–15.
- Frederick Choi (5 papers)
- Charlotte Lambert (5 papers)
- Vinay Koshy (3 papers)
- Sowmya Pratipati (1 paper)
- Tue Do (1 paper)
- Eshwar Chandrasekharan (16 papers)