Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Development and validation of a natural language processing algorithm to pseudonymize documents in the context of a clinical data warehouse (2303.13451v1)

Published 23 Mar 2023 in cs.CL

Abstract: The objective of this study is to address the critical issue of de-identification of clinical reports in order to allow access to data for research purposes, while ensuring patient privacy. The study highlights the difficulties faced in sharing tools and resources in this domain and presents the experience of the Greater Paris University Hospitals (AP-HP) in implementing a systematic pseudonymization of text documents from its Clinical Data Warehouse. We annotated a corpus of clinical documents according to 12 types of identifying entities, and built a hybrid system, merging the results of a deep learning model as well as manual rules. Our results show an overall performance of 0.99 of F1-score. We discuss implementation choices and present experiments to better understand the effort involved in such a task, including dataset size, document types, LLMs, or rule addition. We share guidelines and code under a 3-Clause BSD license.

User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (7)
  1. Xavier Tannier (16 papers)
  2. Perceval Wajsbürt (4 papers)
  3. Alice Calliger (3 papers)
  4. Basile Dura (5 papers)
  5. Alexandre Mouchet (1 paper)
  6. Martin Hilka (1 paper)
  7. Romain Bey (4 papers)
Citations (7)

Summary

We haven't generated a summary for this paper yet.