HeaRT: Health Record Timeliner to visualise patients' medical history from health record text (2306.14379v1)
Abstract: Electronic health records (EHRs), which contain patients' medical histories, tend to be written in freely formatted (unstructured) text because they are complicated by their nature. Quickly understanding a patient's history is challenging and critical because writing styles vary among doctors, which may even cause clinical incidents. This paper proposes a Health Record Timeliner system (HeaRT), which visualises patients' clinical histories directly from natural language text in EHRs. Unlike only a few previous attempts, our system achieved feasible and practical performance for the first time, by integrating a state-of-the-art LLM that recognises clinical entities (e.g. diseases, medicines, and time expressions) and their temporal relations from the raw text in EHRs and radiology reports. By chronologically aligning the clinical entities to the clinical events extracted from a medical report, this web-based system visualises them in a Gantt chart-like format. Our novel evaluation method showed that the proposed system successfully generated coherent timelines from the two sets of radiology reports describing the same CT scan but written by different radiologists. Real-world assessments are planned to improve the remaining issues.
- D. Bell and B. Di Muzio. Minimally invasive adenocarcinoma of the lung. Radiopaedia.org, Apr. 2018.
- TimeLine: visualizing integrated patient records. IEEE transactions on information technology in biomedicine: a publication of the IEEE Engineering in Medicine and Biology Society, 11(4):462–473, July 2007.
- JaMIE: A pipeline japanese medical information extraction system with novel relation annotation. In Proceedings of the Language Resources and Evaluation Conference, pp. 3724–3731. European Language Resources Association, Marseille, France, June 2022.
- Adverse drug events and medication relation extraction in electronic health records with ensemble deep learning methods. Journal of the American Medical Informatics Association: JAMIA, 27(1):39–46, Jan. 2020.
- Visualizing temporal clinical data on the WWW. In Artificial Intelligence in Medicine, pp. 301–311. Springer Berlin Heidelberg, 1999.
- BERT: pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 4171–4186. Association for Computational Linguistics, Stroudsburg, PA, USA, Oct. 2019.
- C. Hallett. Multi-modal presentation of medical histories. In Proceedings of the 13th international conference on Intelligent user interfaces, IUI ’08, pp. 80–89. Association for Computing Machinery, New York, NY, USA, Jan. 2008.
- Building timelines from narrative clinical records: Initial results based-on deep natural language understanding. In Proceedings of BioNLP 2011 Workshop, pp. 146–154. Association for Computational Linguistics, Portland, Oregon, USA, June 2011.
- Extraction of information related to adverse drug events from electronic health record notes: Design of an End-to-End model based on deep learning. JMIR medical informatics, 6(4):e12159, Nov. 2018.
- Clinical comparable corpus describing the same subjects with different expressions. Studies in health technology and informatics, 290:253–257, June 2022.
- Review of temporal reasoning in the clinical domain for timeline extraction: Where we are and where we need to be. Journal of biomedical informatics, 118:103784, June 2021.
- LifeLines: visualizing personal histories. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’96, pp. 221–227. Association for Computing Machinery, New York, NY, USA, Apr. 1996.
- TimeML: Robust specification of event and temporal expressions in text. New directions in question answering, 3:28–34, 2003.
- J. Pustejovsky and A. Stubbs. Increasing informativeness in temporal annotation. In Proceedings of the 5th Linguistic Annotation Workshop, pp. 152–160. Association for Computational Linguistics, Portland, Oregon, USA, June 2011.
- Interactive information visualization to explore and query electronic health records. Foundations and Trends® in Human–Computer Interaction, 5(3):207–298, 2013.
- A comparison of several key information visualization systems for secondary use of electronic health record content. In Proceedings of the NAACL HLT 2010 Second LOUHI Workshop on Text and Data Mining of Health Documents, pp. 76–83. Association for Computational Linguistics, Los Angeles, CA, USA, June 2010.
- Temporal annotation in the clinical domain. Transactions of the Association for Computational Linguistics, 2:143–154, 2014.
- More text please! understanding and supporting the use of visualization for clinical text overview. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, number Paper 422 in CHI ’18, pp. 1–13. Association for Computing Machinery, New York, NY, USA, Apr. 2018.
- Temporal reasoning over clinical text: the state of the art. Journal of the American Medical Informatics Association: JAMIA, 20(5):814–819, Sept. 2013.
- Y. Weerakkody and M. Masters. Adenocarcinoma in situ of lung. Radiopaedia.org, July 2015.
- Fine-tuning BERT for joint entity and relation extraction in chinese medical text. In 2019 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 892–897, Nov. 2019.
- Medical/Clinical Text Annotation Guidelines, Dec. 2021.
- Towards a versatile medical-annotation guideline feasible without heavy medical knowledge: Starting from critical lung diseases. In Proceedings of The 12th Language Resources and Evaluation Conference, pp. 4567–4574. European Language Resources Association, Marseille, France, 2020.