2000 character limit reached
How is Testing Related to Single Statement Bugs? (2403.18226v1)
Published 27 Mar 2024 in cs.SE
Abstract: In this study, we analyzed the correlation between unit test coverage and the occurrence of Single Statement Bugs (SSBs) in open-source Java projects. We analyzed data from the top 100 Maven-based projects on GitHub, which includes 7824 SSBs. Our preliminary findings suggest a weak to moderate correlation, indicating that increased test coverage is somewhat reduce the occurrence of SSBs. However, this relationship is not very strong, emphasizing the need for better tests. Our study contributes to the ongoing discussion on enhancing software quality and provides a basis for future research into effective testing practices aimed at mitigating SSBs.
- Mythical Unit Test Coverage. IEEE Software 35, 3 (2018), 73–79. https://doi.org/10.1109/MS.2017.3281318
- The Impact of Coverage on Bug Density in a Large Industrial Software Project. In 2017 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). 307–313. https://doi.org/10.1109/ESEM.2017.44
- SEQUENCER: Sequence-to-Sequence Learning for End-to-End Program Repair. IEEE Transactions on Software Engineering (2020), 1–1. https://doi.org/10.1109/tse.2019.2940179
- Zimin Chen and Martin Monperrus. 2018. The CodRep Machine Learning on Source Code Competition. arXiv:1807.03200 [cs.SE]
- Lucas Gren and Vard Antinyan. 2017. On the Relation Between Unit Testing and Code Quality. 2017 43rd Euromicro Conference on Software Engineering and Advanced Applications (SEAA) (Aug 2017). https://doi.org/10.1109/seaa.2017.36
- Laura Inozemtseva and Reid Holmes. 2014. Coverage is Not Strongly Correlated with Test Suite Effectiveness. In Proceedings of the 36th International Conference on Software Engineering (Hyderabad, India) (ICSE 2014). Association for Computing Machinery, New York, NY, USA, 435–445. https://doi.org/10.1145/2568225.2568271
- Rafael-Michael Karampatsis and Charles Sutton. 2020. How Often Do Single-Statement Bugs Occur? The ManySStuBs4J Dataset. In Proceedings of the 17th International Conference on Mining Software Repositories (Seoul, Republic of Korea) (MSR ’20). Association for Computing Machinery, New York, NY, USA, 573–577. https://doi.org/10.1145/3379597.3387491
- Akbar Siami Namin and James H. Andrews. 2009. The Influence of Size and Coverage on Test Suite Effectiveness. In Proceedings of the Eighteenth International Symposium on Software Testing and Analysis (Chicago, IL, USA) (ISSTA ’09). Association for Computing Machinery, New York, NY, USA, 57–68. https://doi.org/10.1145/1572272.1572280
- An Empirical Study on Learning Bug-Fixing Patches in the Wild via Neural Machine Translation. ACM Trans. Softw. Eng. Methodol. 28, 4, Article 19 (Sept. 2019), 29 pages. https://doi.org/10.1145/3340544