Artificial intelligence to automate the systematic review of scientific literature (2401.10917v1)
Abstract: AI has acquired notorious relevance in modern computing as it effectively solves complex tasks traditionally done by humans. AI provides methods to represent and infer knowledge, efficiently manipulate texts and learn from vast amount of data. These characteristics are applicable in many activities that human find laborious or repetitive, as is the case of the analysis of scientific literature. Manually preparing and writing a systematic literature review (SLR) takes considerable time and effort, since it requires planning a strategy, conducting the literature search and analysis, and reporting the findings. Depending on the area under study, the number of papers retrieved can be of hundreds or thousands, meaning that filtering those relevant ones and extracting the key information becomes a costly and error-prone process. However, some of the involved tasks are repetitive and, therefore, subject to automation by means of AI. In this paper, we present a survey of AI techniques proposed in the last 15 years to help researchers conduct systematic analyses of scientific literature. We describe the tasks currently supported, the types of algorithms applied, and available tools proposed in 34 primary studies. This survey also provides a historical perspective of the evolution of the field and the role that humans can play in an increasingly automated SLR process.
- Systematic Approaches to a Successful Literature Review. 2nd ed. SAGE Publications; 2016. (2) Kitchenham B, Charters S. Guidelines for performing Systematic Literature Reviews in Software Engineering. EBSE Tech Report. 2007;. (3) Marshall C, Brereton P. Tools to support systematic literature reviews in software engineering: A mapping study. In: International Symposium on Empirical Software Engineering and Measurement; 2013. p. 296–299. (4) van Dinter R, Tekinerdogan B, Catal C. Automation of systematic literature reviews: A systematic literature review. Information and Software Technology. 2021;136:106589. (5) Chapman AL, Morgan LC, Gartlehner G. Semi-automating the manual literature search for systematic reviews increases efficiency. Health Information and Libraries Journal. 2010;27(1):22–27. (6) Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B, Charters S. Guidelines for performing Systematic Literature Reviews in Software Engineering. EBSE Tech Report. 2007;. (3) Marshall C, Brereton P. Tools to support systematic literature reviews in software engineering: A mapping study. In: International Symposium on Empirical Software Engineering and Measurement; 2013. p. 296–299. (4) van Dinter R, Tekinerdogan B, Catal C. Automation of systematic literature reviews: A systematic literature review. Information and Software Technology. 2021;136:106589. (5) Chapman AL, Morgan LC, Gartlehner G. Semi-automating the manual literature search for systematic reviews increases efficiency. Health Information and Libraries Journal. 2010;27(1):22–27. (6) Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Marshall C, Brereton P. Tools to support systematic literature reviews in software engineering: A mapping study. In: International Symposium on Empirical Software Engineering and Measurement; 2013. p. 296–299. (4) van Dinter R, Tekinerdogan B, Catal C. Automation of systematic literature reviews: A systematic literature review. Information and Software Technology. 2021;136:106589. (5) Chapman AL, Morgan LC, Gartlehner G. Semi-automating the manual literature search for systematic reviews increases efficiency. Health Information and Libraries Journal. 2010;27(1):22–27. (6) Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. van Dinter R, Tekinerdogan B, Catal C. Automation of systematic literature reviews: A systematic literature review. Information and Software Technology. 2021;136:106589. (5) Chapman AL, Morgan LC, Gartlehner G. Semi-automating the manual literature search for systematic reviews increases efficiency. Health Information and Libraries Journal. 2010;27(1):22–27. (6) Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Chapman AL, Morgan LC, Gartlehner G. Semi-automating the manual literature search for systematic reviews increases efficiency. Health Information and Libraries Journal. 2010;27(1):22–27. (6) Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Kitchenham B, Charters S. Guidelines for performing Systematic Literature Reviews in Software Engineering. EBSE Tech Report. 2007;. (3) Marshall C, Brereton P. Tools to support systematic literature reviews in software engineering: A mapping study. In: International Symposium on Empirical Software Engineering and Measurement; 2013. p. 296–299. (4) van Dinter R, Tekinerdogan B, Catal C. Automation of systematic literature reviews: A systematic literature review. Information and Software Technology. 2021;136:106589. (5) Chapman AL, Morgan LC, Gartlehner G. Semi-automating the manual literature search for systematic reviews increases efficiency. Health Information and Libraries Journal. 2010;27(1):22–27. (6) Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Marshall C, Brereton P. Tools to support systematic literature reviews in software engineering: A mapping study. In: International Symposium on Empirical Software Engineering and Measurement; 2013. p. 296–299. (4) van Dinter R, Tekinerdogan B, Catal C. Automation of systematic literature reviews: A systematic literature review. Information and Software Technology. 2021;136:106589. (5) Chapman AL, Morgan LC, Gartlehner G. Semi-automating the manual literature search for systematic reviews increases efficiency. Health Information and Libraries Journal. 2010;27(1):22–27. (6) Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. van Dinter R, Tekinerdogan B, Catal C. Automation of systematic literature reviews: A systematic literature review. Information and Software Technology. 2021;136:106589. (5) Chapman AL, Morgan LC, Gartlehner G. Semi-automating the manual literature search for systematic reviews increases efficiency. Health Information and Libraries Journal. 2010;27(1):22–27. (6) Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Chapman AL, Morgan LC, Gartlehner G. Semi-automating the manual literature search for systematic reviews increases efficiency. Health Information and Libraries Journal. 2010;27(1):22–27. (6) Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Marshall C, Brereton P. Tools to support systematic literature reviews in software engineering: A mapping study. In: International Symposium on Empirical Software Engineering and Measurement; 2013. p. 296–299. (4) van Dinter R, Tekinerdogan B, Catal C. Automation of systematic literature reviews: A systematic literature review. Information and Software Technology. 2021;136:106589. (5) Chapman AL, Morgan LC, Gartlehner G. Semi-automating the manual literature search for systematic reviews increases efficiency. Health Information and Libraries Journal. 2010;27(1):22–27. (6) Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. van Dinter R, Tekinerdogan B, Catal C. Automation of systematic literature reviews: A systematic literature review. Information and Software Technology. 2021;136:106589. (5) Chapman AL, Morgan LC, Gartlehner G. Semi-automating the manual literature search for systematic reviews increases efficiency. Health Information and Libraries Journal. 2010;27(1):22–27. (6) Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Chapman AL, Morgan LC, Gartlehner G. Semi-automating the manual literature search for systematic reviews increases efficiency. Health Information and Libraries Journal. 2010;27(1):22–27. (6) Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Automation of systematic literature reviews: A systematic literature review. Information and Software Technology. 2021;136:106589. (5) Chapman AL, Morgan LC, Gartlehner G. Semi-automating the manual literature search for systematic reviews increases efficiency. Health Information and Libraries Journal. 2010;27(1):22–27. (6) Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Chapman AL, Morgan LC, Gartlehner G. Semi-automating the manual literature search for systematic reviews increases efficiency. Health Information and Libraries Journal. 2010;27(1):22–27. (6) Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Semi-automating the manual literature search for systematic reviews increases efficiency. Health Information and Libraries Journal. 2010;27(1):22–27. (6) Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Torres Torres M, Adams CE. RevManHAL: Towards automatic text generation in systematic reviews. Systematic Reviews. 2017;6(1). (7) van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. van Altena AJ, Spijker R, Olabarriaga SD. Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Usage of automation tools in systematic reviews. Research Synthesis Methods. 2019;10(1):72–82. (8) Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Reducing workload in systematic review preparation using automated citation classification. J American Medical Informatics Association. 2006;13(2):206–219. (9) O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. O’Mara-Eves A, Thomas J, McNaught J, Miwa M, Ananiadou S. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews. 2015;4(1). (10) Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, O’Mara-Eves A, Thomas J. Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Text mining for search term development in systematic reviewing: A discussion of some methods and challenges. Research Synthesis Methods. 2017;8(3):355–365. (11) Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8(1). (12) Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Olorisade BK, De Quincey E, Andras P, Brereton P. A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- A critical analysis of studies that address the use of text mining for citation screening in systematic reviews. In: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering; 2016. p. 14:1–11. (13) Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, de Souza ÉF, Napoleão BM, Vijaykumar NL, Baldassarre MT. Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Secondary studies in the academic context: A systematic mapping and survey. Journal of Systems and Software. 2020;170:110734. (14) Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Kitchenham B, Brereton P. A Systematic Review of Systematic Review Process Research in Software Engineering. Information and Software Technology. 2013;55(12):2049–2075. (15) Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Krüger J, Lausberger C, von Nostitz-Wallwitz I, Saake G, Leich T. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empirical Software Engineering. 2020;25:627–677. (16) Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Davies KS. Formulating the Evidence Based Practice Question: A Review of the Frameworks. Evidence Based Library and Information Practice. 2011;6(2):75–80. (17) Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Mergel GD, Silveira MS, da Silva TS. A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- A Method to Support Search String Building in Systematic Literature Reviews through Visual Text Mining. In: Proc. ACM Symposium on Applied Computing; 2015. p. 1594––1601. (18) Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lefebvre C, Manheimer E, Glanville J. Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Searching for Studies. In: Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. John Wiley and Sons; 2008. p. 95–150. (19) Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Booth A, Sutton A, Papaioannou D. 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- 5. In: Defining your scope. 2nd ed. SAGE Publications; 2016. p. 83–108. (20) Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clinical Epidemiology. 2009;62(10):1–34. (21) Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Kitchenham B. Procedures for Performing Systematic Reviews. Department of Computer Science: Keele University, UK; 2004. (22) Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Stansfield C, Thomas J, Kavanagh J. ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- ’Clustering’ documents automatically to support scoping reviews of research: a case study. Research synthesis methods. 2013;4(3):230–241. (23) Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Pham B, Bagheri E, Rios P, Pourmasoumi A, Robson RC, Hwee J, et al. Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Improving the conduct of systematic reviews: a process mining perspective. Journal of Clinical Epidemiology. 2018;103:101–111. (24) Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cohen AM, Ambert K, McDonagh M. Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update. Journal of the American Medical Informatics Association. 2009;16(5):690. (25) Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Kim S, Choi J. An SVM-based high-quality article classifier for systematic reviews. Journal of Biomedical Informatics. 2014;47:153–159. (26) Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Bannach-Brown A, Przybyła P, Thomas J, Rice ASC, Ananiadou S, Liao J, et al. Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error. Systematic Reviews. 2019;8(1):23. (27) Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Thomas J, McDonald S, Noel-Storr A, Shemilt I, Elliott J, Mavergames C, et al. Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Machine learning reduced workload with minimal risk of missing studies: development and evaluation of a randomized controlled trial classifier for Cochrane Reviews. J Clinical Epidemiology. 2021;133:140–151. (28) Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O’Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- A new algorithm for reducing the workload of experts in performing systematic reviews. Journal of the American Medical Informatics Association. 2010;17(4):446–453. (29) Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Frunza O, Inkpen D, Matwin S. Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Building systematic reviews using automatic text classification techniques. In: 23rd Int. Conf. Computational Linguistics; 2010. p. 303–311. (30) García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. García Adeva JJ, Pikatza Atxa JM, Ubeda Carrillo M, Ansuategi Zengotitabengoa E. Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications. 2014;41(4):1498–1508. (31) Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Almeida H, Meurs MJ, Kosseim L, Tsang A. Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Data Sampling and Supervised Learning for HIV Literature Screening. IEEE Transactions on Nanobioscience. 2016;15(4):354–361. (32) Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Wallace BC, Small K, Brodley CE, Lau J, Trikalinos TA. Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Deploying an interactive machine learning system in an Evidence-based Practice Center: Abstrackr. In: Proc 2nd ACM SIGHIT International Health Informatics Symposium; 2012. p. 819–823. (33) Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Kontonatsios G, Brockmeier AJ, Przybyła P, McNaught J, Mu T, Goulermas JY, et al. A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- A semi-supervised approach using label propagation to support citation screening. J Biomedical Informatics. 2017;72:67–76. (34) Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Kraft NA, Menzies T. Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Finding better active learners for faster literature reviews. Empirical Software Engineering. 2018;23(6):3161–3186. (35) Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Yu Z, Menzies T. FAST22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT: An intelligent assistant for finding relevant papers. Expert Systems with Applications. 2019;120:57–71. (36) Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Ros R, Bjarnason E, Runeson P. A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- A machine learning approach for semi-automated search and selection in literature studies. In: 21st Int. Conf. Evaluation and Assessment in Software Engineering; 2017. p. 118–127. (37) Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Felizardo KR, Andery GF, Paulovich FV, Minghim R, Maldonado JC. A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- A visual analysis approach to validate the selection review of primary studies in systematic reviews. Information and Software Technology. 2012;54(10):1079–1091. (38) Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Alencar AB, de Oliveira MCF, Paulovich FV. Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Seeing beyond reading: a survey on visual text analytics. WIREs Data Mining and Knowledge Discovery. 2012;2(6):476–492. (39) Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Octaviano FR, Felizardo KR, Maldonado JC, Fabbri SCPF. Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Semi-automatic selection of primary studies in systematic literature reviews: is it reasonable? Empirical Software Engineering. 2015;20(6):1898–1917. (40) Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Langlois A, Nie JY, Thomas J, Hong QN, Pluye P. Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Discriminating between empirical studies and nonempirical works using automated text classification. Research Synthesis Methods. 2018;9(4):587–601. (41) Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Sun Y, Yang Y, Zhang H, Zhang W, Wang Q. Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Towards evidence-based ontology for supporting systematic literature review. In: 16th Int. Conf. Evaluation and Assessment in Software Engineering; 2012. p. 171–175. (42) Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Erekhinskaya T, Balakrishna M, Tatu M, Werner S, Moldovan D. Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Knowledge extraction for literature review. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. IEEE; 2016. p. 221–222. (43) Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Lucic A, Blake CL. Improving Endpoint Detection to Support Automated Systematic Reviews. AMIA Ann Symp proc. 2016;p. 1900–1909. (44) Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Teslyuk A. The concept of system for automated scientific literature reviews generation. In: International Conference on Computational Science. vol. 12139 LNCS. Springer; 2020. p. 437–443. (45) Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Liu M, Calvo RA, Rus V. Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Automatic question generation for literature review writing support. In: International Conference on Intelligent Tutoring Systems. vol. 6094 LNCS; 2010. p. 45–54. (46) Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Rizzolo N, Roth D. Modeling Discriminative Global Inference. In: International Conference on Semantic Computing (ICSC); 2007. p. 597–604. (47) Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Systematic review automation technologies. Systematic Reviews. 2014;3(1). (48) Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Beller E, Clark J, Tsafnat G, Adams C, Diehl H, Lund H, et al. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2018;7(1). (49) Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Tsou AY, Treadwell JR, Erinoff E, Schoelles K. Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- Machine learning for screening prioritization in systematic reviews: Comparative performance of Abstrackr and EPPI-Reviewer. Systematic Reviews. 2020;9(1):73. (50) Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Gates A, Gates M, Sebastianski M, Guitard S, Elliott SA, Hartling L. The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- The semi-automation of title and abstract screening: A retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews. BMC Medical Research Methodology. 2020;20(1):139. (51) Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing. 2020;408:189–215.
- José de la Torre-López (1 paper)
- Aurora Ramírez (9 papers)
- José Raúl Romero (9 papers)