ChatGPT, Llama, can you write my report? An experiment on assisted digital forensics reports written using (Local) Large Language Models
Abstract: Generative AIs, especially LLMs such as ChatGPT or Llama, have advanced significantly, positioning them as valuable tools for digital forensics. While initial studies have explored the potential of ChatGPT in the context of investigations, the question of to what extent LLMs can assist the forensic report writing process remains unresolved. To answer the question, this article first examines forensic reports with the goal of generalization (e.g., finding the `average structure' of a report). We then evaluate the strengths and limitations of LLMs for generating the different parts of the forensic report using a case study. This work thus provides valuable insights into the automation of report writing, a critical facet of digital forensics investigations. We conclude that combined with thorough proofreading and corrections, LLMs may assist practitioners during the report writing process but at this point cannot replace them.
- Digital forensics as a service: Stepping up the game. Forensic Science International: Digital Investigation, 35, 301021.
- Automated digital forensics. Technical Report Leeds Beckett University.
- Casey, E. (2011). Digital evidence and computer crime: Forensic science, computers, and the internet. Academic press.
- Natural Language Generation in Health Care. Journal of the American Medical Informatics Association, 4, 473–482. URL: https://doi.org/10.1136/jamia.1997.0040473. doi:10.1136/jamia.1997.0040473.
- ENFSI guideline for evaluative reporting in forensic science: A primer for legal practitioners. Criminal Law and Justice Weekly, 180, 189–193.
- Farrell Jr, P. F. (2009). A framework for automated digital forensic reporting. Technical Report Naval Postgraduate School Monterey CA.
- Garfinkel, S. (2012). Digital forensics xml and the dfxml toolset. Digital Investigation, 8, 161–174.
- Digital forensic evidence in the courtroom: understanding content and quality. Nw. J. Tech. & Intell. Prop., 12, 121. URL: https://scholarlycommons.law.northwestern.edu/njtip/vol12/iss2/5.
- Survey of the state of the art in natural language generation: Core tasks, applications and evaluation. Journal of Artificial Intelligence Research, 61, 65–170. doi:10.1613/jair.5477.
- The adoption of automation in cyber forensics. In 2020 Conference on Information Communications Technology and Society (ICTAS) (pp. 1–6). IEEE.
- Chatgpt as a copilot for investigating digital evidence. CEUR-WS, 3423. URL: https://ceur-ws.org/Vol-3423/paper6.pdf.
- Natural language generation model for mammography reports simulation. IEEE Journal of Biomedical and Health Informatics, 24, 2711–2717. doi:10.1109/JBHI.2020.2980118.
- Horsman, G. (2021). The different types of reports produced in digital forensic investigations. Science & Justice, 61, 627–634.
- A comparative study based digital forensic tool: complete automated tool. Int. J. Forensic Comput. Sci, 9, 22–29.
- Challenges with automation in digital forensic investigations. arXiv preprint arXiv:1303.4498, .
- Diverging deep learning cognitive computing techniques into cyber forensics. Forensic Science International: Synergy, 1, 61–67.
- Guide to integrating forensic techniques into incident response. Tech. Rep. 800-86, .
- Current challenges and future research areas for digital forensic investigation. arXiv preprint arXiv:1604.03850, .
- Automation for digital forensics: Towards a definition for the community. Forensic Science International, (p. 111769).
- Pollitt, M. (2014). Forensics Report Writing. YouTube. URL: https://www.youtube.com/watch?v=a4dwypa12c4.
- Impacts of increasing volume of digital forensic data: A survey and future research challenges. Digital Investigation, 11, 273–294.
- Building applied natural language generation systems. Natural Language Engineering, 3, 57–87. doi:10.1017/S1351324997001502.
- Rughani, P. H. (2017). Artificial intelligence based digital forensics framework. International Journal of Advanced Research in Computer Science, 8.
- ChatGPT for digital forensic investigation: The good, the bad, and the unknown. Forensic Science International: Digital Investigation, 46, 301609. URL: https://www.sciencedirect.com/science/article/pii/S266628172300121X. doi:https://doi.org/10.1016/j.fsidi.2023.301609.
- Wanner, L. (2010). Report generation. Handbook of Natural Language Processing, (pp. 533–555).
- From measurement data to environmental information: Marquis - a multimodal air quality information service for the general public. In J. Hřebíček, & Swayne D. A. (Eds.), Proceedings of the 6th International Symposium on Environmental Software Systems (ISESS 2007) (pp. 1–10). IFIP Conference Series. International Symposium on Environmental Software Systems (6th : 2007) ; Conference date: 22-05-2007 Through 25-05-2007.
- System demonstration multilingual weather forecast generation system. In Natural Language Generation. Niagara-on-the-Lake, Ontario, Canada: Association for Computational Linguistics. URL: https://aclanthology.org/W98-1434.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.