Extracting Medication Changes in Clinical Narratives using Pre-trained Language Models
Abstract: An accurate and detailed account of patient medications, including medication changes within the patient timeline, is essential for healthcare providers to provide appropriate patient care. Healthcare providers or the patients themselves may initiate changes to patient medication. Medication changes take many forms, including prescribed medication and associated dosage modification. These changes provide information about the overall health of the patient and the rationale that led to the current care. Future care can then build on the resulting state of the patient. This work explores the automatic extraction of medication change information from free-text clinical notes. The Contextual Medication Event Dataset (CMED) is a corpus of clinical notes with annotations that characterize medication changes through multiple change-related attributes, including the type of change (start, stop, increase, etc.), initiator of the change, temporality, change likelihood, and negation. Using CMED, we identify medication mentions in clinical text and propose three novel high-performing BERT-based systems that resolve the annotated medication change characteristics. We demonstrate that our proposed systems improve medication change classification performance over the initial work exploring CMED.
- R. J. Fitzgerald, Medication errors: the importance of an accurate drug history., Br J Clin Pharmacol 67 (2009). doi:10.1111/j.1365-2125.2009.03424.x.
- The completeness of medication histories in hospital medical records of patients admitted to general internal medicine wards, Br J Clin Pharmacol 49 (2000) 597–603. doi:10.1046/j.1365-2125.2000.00204.x.
- Using electronic health records for population health research: A review of methods and applications., Annual Review of Public Health 37 (2016) 61–81. doi:10.1146/annurev-publhealth-032315-021353.
- Extracting medication information from clinical text, J Am Med Inform Assoc JAMIA 17 (2010) 514–518. doi:10.1136/jamia.2010.003947.
- Clinical information extraction applications: A literature review, J Biomed Inform 77 (2018) 34–49. doi:10.1016/j.jbi.2017.11.011.
- J. Patrick, M. Li, A cascade approach to extracting medication events, in: Proceedings of the Australasian Language Technology Association Workshop 2009, Sydney, Australia, 2009, pp. 99–103. URL: https://aclanthology.org/U09-1014.
- 2010 i2b2/VA challenge on concepts, assertions, and relations in clinical text, J Am Med Inform Assoc JAMIA 18 (2011) 552–556. doi:10.1136/amiajnl-2011-000203.
- Advancing the state of the art in automatic extraction of adverse drug events from narratives, J Am Med Inform Assoc JAMIA 27 (2020). doi:10.1093/jamia/ocz206.
- Overview of the first natural language processing challenge for extracting medication, indication, and adverse drug events from electronic health record notes(MADE 1.0), Drug Safety 42 (2019) 99–111. doi:10.1007/s40264-018-0762-z.
- The ddi corpus: An annotated corpus with pharmacological substances and drug–drug interactions, J Biomed Inform X 46 (2013) 914–920. doi:10.1016/j.jbi.2013.07.011.
- Aspect-based sentiment analysis of drug reviews applying cross-domain and cross-data learning, in: Proceedings of the 2018 International Conference on Digital Health, DH ’18, Association for Computing Machinery, New York, NY, USA, 2018, p. 121–125. doi:10.1145/3194658.3194677.
- Maximum entropy modeling for mining patient medication status from free text., AMIA Annu Symp Proc. (2002) 587–591. URL: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2244576/.
- Classification of medication status change in clinical narratives, AMIA Annu Symp Proc. 2010 (2010) 762–766. URL: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3041444/.
- ConText: an algorithm for determining negation, experiencer, and temporal status from clinical reports., J Biomed Inform. 42 (2009) 839–851. doi:10.1016/j.jbi.2009.05.002.
- Learning to detect and understand drug discontinuation events from clinical narratives., J Am Med Inform Assoc JAMIA 26 (2019) 943–951. doi:10.1093/jamia/ocz048.
- Learning the grammar of prescription: recurrent neural network grammars for medication information extraction in clinical texts, CoRR abs/2004.11622 (2020). URL: https://arxiv.org/abs/2004.11622.
- Toward Understanding Clinical Context of Medication Change Events in Clinical Narratives, AMIA Annu Symp Proc 2021 (2021b) 833–842. URL: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8861744/.
- BERT: Pre-training of deep bidirectional transformers for language understanding, in: North American Chapter of the Association for Computational Linguistics, 2019, pp. 4171–4186. doi:10.18653/v1/N19-1423.
- Community annotation experiment for ground truth generation for the i2b2 medication challenge, J Am Med Inform Assoc JAMIA 17 (2010) 519–23. doi:10.1136/jamia.2010.004200.
- Medex: a medication information extraction system for clinical narratives, J Am Med Inform Assoc JAMIA 17,1 (2010) 19–24. doi:10.1197/jamia.M3378.
- Y. Hui, Automatic extraction of medication information from medical discharge summaries, J Am Med Inform Assoc JAMIA 17,5 (2010) 545–548. doi:10.1136/jamia.2010.003863.
- Fable: A semi-supervised prescription information extraction system, AMIA Annu Symp Proc. 2018 (2018) 1534–1543. URL: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6371278/.
- Extraction of information related to adverse drug events from electronic health record notes: Design of an end-to-end model based on deep learning, JMIR Med Inform 6 (2018). doi:10.2196/12159.
- Clinical relation extraction toward drug safety surveillance using electronic health record narratives: Classical learning versus deep learning, JMIR Public Health Surveill. 4 (2018) e29. doi:10.2196/publichealth.9361.
- An ensemble of neural models for nested adverse drug events and medication extraction with subwords, J Am Med Inform Assoc JAMIA 27 (2019) 22–30. doi:10.1093/jamia/ocz075.
- CLAMP – a toolkit for efficiently building customized clinical natural language processing pipelines, J Am Med Inform Assoc JAMIA 25 (2017) 331–336. doi:10.1093/jamia/ocx132.
- Extracting drug names and associated attributes from discharge summaries: Text mining study, JMIR Med Inform 2021 9 (2021). doi:10.2196/24678.
- S. K. Sahu, A. Anand, Drug-drug interaction extraction from biomedical texts using long short-term memory network, J Biomed Inform 86 (2018) 15–24. doi:10.1016/j.jbi.2018.08.005.
- Publicly available clinical BERT embeddings, in: Clinical Natural Language Processing Workshop, 2019, pp. 72–78. doi:10.18653/v1/W19-1909.
- Biobert: a pre-trained biomedical language representation model for biomedical text mining, Bioinformatics (2019). doi:10.1093/bioinformatics/btz682.
- Domain-specific language model pretraining for biomedical natural language processing, ACM Transactions on Computing for Healthcare 3 (2022) 1–23. doi:10.1145/3458754.
- Extraction of information related to drug safety surveillance from electronic health record notes: Joint modeling of entities and relations using knowledge-aware neural attentive models, JMIR Med Inform 8 (2020) e18417. doi:10.2196/18417.
- A contextual multi-task neural approach to medication and adverse events identification from clinical text, J Biomed Inform 125 (2022) 103960. doi:10.1016/j.jbi.2021.103960.
- Modeling drug exposure data in electronic medical records: an application to warfarin, ”AMIA Annu Symp Proc” (2018) 815–823. URL: https://pubmed.ncbi.nlm.nih.gov/22195139/.
- Y. Fan, R. Zhang, Using natural language processing methods to classify use status of dietary supplements in clinical notes, BMC Medical Informatics and Decision Making 18 (2018). doi:10.1186/s12911-018-0626-6.
- Heart failure medications detection and prescription status classification in clinical narrative documents, Stud Health Technol Inform (2015). URL: "https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5009609/".
- Creation of a new longitudinal corpus of clinical narratives, J Biomed Inform 58S (2015). doi:10.1016/j.jbi.2015.09.018.
- M. Eberts, A. Ulges, Span-based joint entity and relation extraction with transformer pre-training, in: Eur Conf on Artif Intell, 2020, pp. 2006–2013. URL: https://ebooks.iospress.nl/volumearticle/55116.
- Z. Zhong, D. Chen, A frustratingly easy approach for entity and relation extraction, in: Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics, Online, 2021, pp. 50–61. doi:10.18653/v1/2021.naacl-main.5.
- Transformers: State-of-the-art natural language processing, in: Conference on Empirical Methods in Natural Language Processing: System Demonstrations, Association for Computational Linguistics, Online, 2020, pp. 38–45. URL: https://www.aclweb.org/anthology/2020.emnlp-demos.6.
- Scispacy: Fast and robust models for biomedical natural language processing, Proceedings of the 18th BioNLP Workshop and Shared Task (2019). doi:10.18653/v1/w19-5034.
- I. Loshchilov, F. Hutter, Fixing weight decay regularization in adam, CoRR abs/1711.05101 (2017). URL: http://arxiv.org/abs/1711.05101.
- An empirical investigation of statistical significance in NLP, in: Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Association for Computational Linguistics, Jeju Island, Korea, 2012, pp. 995–1005. URL: https://aclanthology.org/D12-1091.
- Lifelines: using visualization to enhance navigation and analysis of patient records, Proc AMIA Symp. (1998) 76–80. URL: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2232192/.
- Designing a medication timeline for patients and physicians, J Am Med Inform Assoc JAMIA 26 (2019) 95–105. doi:10.1093/jamia/ocy143.
- Temporal reasoning over clinical text: the state of the art, J Am Med Inform Assoc JAMIA 5 (2013) 814–819. doi:10.1136/amiajnl-2013-001760.
Paper Prompts
Sign up for free to create and run prompts on this paper.