2000 character limit reached
MANTIS at #SMM4H 2023: Leveraging Hybrid and Ensemble Models for Detection of Social Anxiety Disorder on Reddit (2312.09451v1)
Published 28 Nov 2023 in cs.CL
Abstract: This paper presents our system employed for the Social Media Mining for Health 2023 Shared Task 4: Binary classification of English Reddit posts self-reporting a social anxiety disorder diagnosis. We systematically investigate and contrast the efficacy of hybrid and ensemble models that harness specialized medical domain-adapted transformers in conjunction with BiLSTM neural networks. The evaluation results outline that our best performing model obtained 89.31% F1 on the validation set and 83.76% F1 on the test set.
- Publicly available clinical BERT embeddings. In Proceedings of the 2nd Clinical Natural Language Processing Workshop, pages 72–78. Association for Computational Linguistics.
- Ensemble deep learning: A review. Engineering Applications of Artificial Intelligence, 115:105151.
- MentalBERT: Publicly available pretrained language models for mental healthcare. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 7184–7190, Marseille, France. European Language Resources Association.
- Siegfried Kasper. 2006. Anxiety disorders: under-diagnosed and insufficiently treated. International Journal of Psychiatry in Clinical Practice, 10(sup1):3–9.
- Overview of the eighth social media mining for health applications (#smm4h) shared tasks at the AMIA 2023 annual symposium. Proceedings of the Eighth Social Media Mining for Health Applications (#SMM4H) Workshop and Shared Task.
- Psychbert: a mental health language model for social media mental health behavioral analysis. In 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pages 1077–1082. IEEE.
- Transformers: State-of-the-art natural language processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 38–45.
- Natural language processing applied to mental illness detection: A narrative review. NPJ Digital Medicine, 5:46.
- Sourabh Zanwar (7 papers)
- Daniel Wiechmann (9 papers)
- Yu Qiao (563 papers)
- Elma Kerz (10 papers)