Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
129 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Past, Present, and Future of Citation Practices in HCI (2405.16526v5)

Published 26 May 2024 in cs.HC, cs.CY, and cs.DL

Abstract: Science is a complex system comprised of many scientists who individually make decisions that, due to the size and nature of the academic system, largely do not affect the system as a whole. However, certain decisions at the meso-level of research communities, such as the Human-Computer Interaction (HCI) community, may result in deep and long-lasting behavioral changes in scientists. In this article, we provide empirical evidence on how a change in editorial policies introduced at the ACM CHI Conference in 2016 destabilized the CHI research community and launched it on an expansive path, denoted by a year-by-year increase in the mean number of references included in CHI articles. If this near-linear trend continues undisrupted, an article at CHI 2030 will include on average almost 130 references. The trend towards more citations reflects a citation culture where quantity is prioritized over quality, contributing to both author and peer reviewer fatigue. Our exploratory analysis underscores the profound impact of meso-level policy adjustments on the evolution of scientific fields and disciplines, urging all stakeholders to carefully consider the broader implications of such changes.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (31)
  1. A Billion-dollar Donation: Estimating The Cost Of Researchers’ Time Spent On Peer Review. Research Integrity and Peer Review 6, 1 (2021), 8 pages. https://doi.org/10.1186/s41073-021-00118-2
  2. Christoph Bartneck and Jun Hu. 2009. Scientometric Analysis of the CHI Proceedings. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’09). Association for Computing Machinery, New York, NY, USA, 699–708. https://doi.org/10.1145/1518701.1518810
  3. Christoph Bartneck and Servaas Kokkelmans. 2011. Detecting H-index Manipulation Through Self-citation Analysis. Scientometrics 87, 1 (April 2011), 85–98. https://doi.org/10.1007/s11192-010-0306-5
  4. Alan F. Blackwell. 2015. HCI as an Inter-Discipline. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA ’15). Association for Computing Machinery, New York, NY, USA, 503–516. https://doi.org/10.1145/2702613.2732505
  5. Mihaly Csikszentmihalyi. 2014. The Systems Model of Creativity. Springer, Dordrecht, Netherlands. https://doi.org/10.1007/978-94-017-9085-7
  6. Marc A. Edwards and Siddhartha Roy. 2017. Academic Research in the 21st Century: Maintaining Scientific Integrity in a Climate of Perverse Incentives and Hypercompetition. Environmental Engineering Science 34, 1 (2017), 51–61. https://doi.org/10.1089/ees.2016.0223
  7. Todd Feathers. 2019. Flawed Algorithms Are Grading Millions of Students’ Essays. https://www.vice.com/en/article/pa7dj9/flawed-algorithms-are-grading-millions-of-students-essays
  8. The Strain on Scientific Publishing. arXiv:2309.15884
  9. Google Scholar is Manipulatable. arXiv:2402.04607
  10. Meta-research: Evaluation and Improvement of Research Methods and Practices. PLoS Biology 13, 10 (2015), e1002264.
  11. Unsupervised Anomaly Detection in Journal-Level Citation Networks. In Proceedings of the ACM/IEEE Joint Conference on Digital Libraries in 2020 (JCDL ’20). Association for Computing Machinery, New York, NY, USA, 27–36. https://doi.org/10.1145/3383583.3398531
  12. Joseph Kaye. 2009. Some Statistical Analyses of CHI. In CHI ’09 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’09). Association for Computing Machinery, New York, NY, USA, 2585–2594. https://doi.org/10.1145/1520340.1520364
  13. Scott Kim. 1995. Interdisciplinary Cooperation. In Readings in Human–Computer Interaction, Ronald M. Baecker, Jonathan Grudin, William A.S. Buxton, and Saul Greenberg (Eds.). Morgan Kaufmann, 304–311. https://doi.org/10.1016/B978-0-08-051574-8.50033-9
  14. Detecting anomalous citation groups in journal networks. Scientific Reports 11, 1 (2021). https://doi.org/10.1038/s41598-021-93572-3
  15. Kayvan Kousha and Mike Thelwall. 2022. Artificial Intelligence Technologies to Support Research Assessment: A Review. arXiv:2212.06574
  16. Weaving the Topics of CHI: Using Citation Network Analysis to Explore Emerging Trends. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3290607.3312776
  17. Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews. arXiv:2403.07183
  18. Can Large Language Models Provide Useful Feedback On Research Papers? A Large-scale Empirical Analysis. arXiv:2310.01783
  19. CHI 1994-2013: Mapping Two Decades of Intellectual Progress through Co-Word Analysis. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’14). Association for Computing Machinery, New York, NY, USA, 3553–3562. https://doi.org/10.1145/2556288.2556969
  20. Robert K. Merton. 1968. The Matthew Effect in Science. Science 159, 3810 (1968), 56–63. https://doi.org/10.1126/science.159.3810.56
  21. M. E. J. Newman. 2009. The First-mover Advantage in Scientific Publication. Europhysics Letters 86, 6 (jun 2009), 68001. https://doi.org/10.1209/0295-5075/86/68001
  22. Jonas Oppenlaender and Joonas Hämäläinen. 2023. Mapping the Challenges of HCI: An Application and Evaluation of ChatGPT and GPT-4 for Mining Insights at Scale. arXiv:2306.05036
  23. Antti Oulasvirta and Kasper Hornbæk. 2016. HCI Research as Problem-Solving. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). Association for Computing Machinery, New York, NY, USA, 4956–4967. https://doi.org/10.1145/2858036.2858283
  24. Victor Le Pochat. 2024. Reflecting on Research Practices. Commun. ACM 67, 5 (may 2024), 37–39. https://doi.org/10.1145/3651965
  25. Henning Pohl and Aske Mottelson. 2019. How We Guide, Write, and Cite at CHI. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3290607.3310429
  26. Mark A. Runco and Garrett J. Jaeger. 2012. The Standard Definition of Creativity. Creativity Research Journal 24, 1 (2012), 92–96. https://doi.org/10.1080/10400419.2012.650092
  27. Nihar B. Shah. 2022. Challenges, Experiments, and Computational Solutions in Peer Review. Commun. ACM 65, 6 (may 2022), 76–87. https://doi.org/10.1145/3528086
  28. Literature Reviews in HCI: A Review of Reviews. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 509, 24 pages. https://doi.org/10.1145/3544548.3581332
  29. MetaWriter: Exploring the Potential and Perils of AI Writing Support in Scientific Peer Review. Proc. ACM Hum.-Comput. Interact. 8, CSCW1, Article 94 (apr 2024), 32 pages. https://doi.org/10.1145/3637371
  30. Publication Pressure and Scientific Misconduct in Medical Scientists. Journal of Empirical Research on Human Research Ethics 9, 5 (2014), 64–71. https://doi.org/10.1177/1556264614552421
  31. Jess Weatherbed. 2024. Texas is Replacing Thousands of Human Exam Graders with AI. https://www.theverge.com/2024/4/10/24126206/texas-staar-exam-graders-ai-automated-scoring-engine
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets