Gamified GUI testing with Selenium in the IntelliJ IDE: A Prototype Plugin (2403.09842v1)
Abstract: Software testing is a crucial phase in software development, enabling the detection of issues and defects that may arise during the development process. Addressing these issues enhances software applications' quality, reliability, user experience, and performance. Graphical User Interface (GUI) testing, one such technique, involves mimicking a regular user's interactions with an application to identify defects. However, GUI testing is often underutilized due to its perceived repetitiveness, error-proneness, and lack of immediate feedback on test quality. In recent years, gamification-incorporating game elements in non-game contexts to boost interest, motivation, and engagement-has gained traction in various fields, including software engineering and education. This paper presents GIPGUT: a prototype of a gamification plugin for IntelliJ IDEA, an Integrated Development Environment (IDE) that supports scripted GUI testing. The plugin enhances testers' engagement with typically monotonous and tedious tasks through achievements, rewards, and profile customization. A preliminary prototype evaluation was conducted with a small group of users to assess its usability and the impact of gamification on the GUI testing process. The results indicate high usability and positive reception of the gamification elements. However, due to the limited sample size of participants, further research is necessary to understand the plugin's effectiveness fully.
- The Diversity of Gamification Evaluation in the Software Engineering Education and Industry: Trends, Comparisons and Gaps. In 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET). 154–164. https://doi.org/10.1109/ICSE-SEET52601.2021.00025
- Secret ninja testing with HALO software engineering. In Proceedings of the 4th international workshop on Social software engineering. 43–47.
- John Brooke. 1995. SUS: A quick and dirty usability scale. Usability Eval. Ind. 189 (11 1995).
- A Metric Framework for the Gamification of Web and Mobile GUI Testing. In 2021 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW). 126–129. https://doi.org/10.1109/ICSTW52544.2021.00032
- Y.k. Chou. 2015. Actionable Gamification: Beyond Points, Badges, and Leaderboards. Createspace Independent Publishing Platform. https://books.google.it/books?id=jFWQrgEACAAJ
- A Framework for the Gamification of GUI Testing. Springer Nature Switzerland, Cham, 215–242. https://doi.org/10.1007/978-3-031-33338-5_10
- On Effectiveness and Efficiency of Gamified Exploratory GUI Testing. IEEE Transactions on Software Engineering (2023), 1–16. https://doi.org/10.1109/TSE.2023.3348036
- Igor Ernesto Ferreira Costa and Sandro Ronaldo Bezerra Oliveira. 2019. A Systematic Strategy to Teaching of Exploratory Testing using Gamification.. In ENASE. 307–314.
- From Game Design Elements to Gamefulness: Defining ”Gamification”. In Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments (Tampere, Finland) (MindTrek ’11). Association for Computing Machinery, New York, NY, USA, 9–15. https://doi.org/10.1145/2181037.2181040
- Daniel J. Dubois and Giordano Tamburrelli. 2013. Understanding Gamification Mechanisms for Software Development. In Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering (Saint Petersburg, Russia) (ESEC/FSE 2013). Association for Computing Machinery, New York, NY, USA, 659–662. https://doi.org/10.1145/2491411.2494589
- A Review on Tools, Mechanics, Benefits, and Challenges of Gamified Software Testing. ACM Comput. Surv. 55, 14s, Article 310 (jul 2023), 37 pages. https://doi.org/10.1145/3582273
- Guidelines for GUI Testing Maintenance: A Linter for Test Smell Detection. In Proceedings of the 13th International Workshop on Automating Test Case Design, Selection and Evaluation (Singapore, Singapore) (A-TEST 2022). Association for Computing Machinery, New York, NY, USA, 17–24. https://doi.org/10.1145/3548659.3561306
- GERRY: A Gamified Browser Tool for GUI Testing. In Proceedings of the 1st International Workshop on Gamification of Software Development, Verification, and Validation (Singapore, Singapore) (Gamify 2022). Association for Computing Machinery, New York, NY, USA, 2–9. https://doi.org/10.1145/3548771.3561408
- A framework for gamification in software engineering. Journal of Systems and Software 132 (2017), 21–40.
- A systematic mapping study of web application testing. Information and Software Technology 55 (08 2013), 1374–1396. https://doi.org/10.1016/j.infsof.2013.02.006
- Cheng Hsiu Li. 2019. Gamification of an asynchronous HTML5-related competency-based guided learning system. In IOP Conference Series: Materials Science and Engineering, Vol. 658. IOP Publishing, 012004.
- Gamification in software engineering – A systematic mapping. Information and Software Technology 57 (2015), 157–168. https://doi.org/10.1016/j.infsof.2014.08.007
- An architecture for software engineering gamification. Tsinghua Science and Technology 25, 6 (2020), 776–797. https://doi.org/10.26599/TST.2020.9010004
- A competitive-collaborative approach for introducing software engineering in a CS2 class. In 2013 26th International Conference on Software Engineering Education and Training (CSEE&T). IEEE, 41–50.
- Philipp Straubinger and Gordon Fraser. 2023. Improving Testing Behavior by Gamifying IntelliJ. arXiv:2310.11171 [cs.SE]
- Vladimir Uskov and Bhuvana Sekar. 2014. Gamification of software engineering curriculum. In 2014 IEEE Frontiers in Education Conference (FIE) Proceedings. 1–8. https://doi.org/10.1109/FIE.2014.7044098
- Giacomo Garaccione (2 papers)
- Tommaso Fulcini (4 papers)
- Paolo Stefanut Bodnarescul (1 paper)
- Riccardo Coppola (11 papers)
- Luca Ardito (4 papers)