Laypeople’s use of generative AI in legal information-processing tasks

Investigate how laypeople use generative AI chatbots for legal information-processing tasks such as legal information retrieval and translation by conducting naturalistic evaluations of everyday user interactions, in order to characterize typical usage patterns and associated risks of errors.

Background

The paper notes that everyday users increasingly turn to technology for legal advice and information-processing tasks (e.g., translation, legal information retrieval), but there is limited evidence about how chatbots affect these users. Errors in such contexts can be catastrophic, as in asylum applications where machine translation errors can lead to rejections.

The authors emphasize the need for naturalistic evaluations to understand real-world use, highlighting current gaps in knowledge about how laypeople interact with generative AI for legal tasks.

References

It is unclear how people are using generative AI for such tasks.

Promises and pitfalls of artificial intelligence for legal applications  (2402.01656 - Kapoor et al., 2024) in Section “Information processing,” paragraph “We need to better understand how generative AI impacts laypeople”

However, as LLMs become more advanced, it remains unclear whether users will continue to rely on this intermediary layer of human validation or instead default directly to LLM-generated answers.

Credible, Not Always Correct: How Reddit Users Verify AI-Generated Legal Advice  (2608.13369 - Owens et al., 13 Aug 2026) in Section 5, Discussion