Multitask learning for recognizing stress and depression in social media (2305.18907v2)
Abstract: Stress and depression are prevalent nowadays across people of all ages due to the quick paces of life. People use social media to express their feelings. Thus, social media constitute a valuable form of information for the early detection of stress and depression. Although many research works have been introduced targeting the early recognition of stress and depression, there are still limitations. There have been proposed multi-task learning settings, which use depression and emotion (or figurative language) as the primary and auxiliary tasks respectively. However, although stress is inextricably linked with depression, researchers face these two tasks as two separate tasks. To address these limitations, we present the first study, which exploits two different datasets collected under different conditions, and introduce two multitask learning frameworks, which use depression and stress as the main and auxiliary tasks respectively. Specifically, we use a depression dataset and a stressful dataset including stressful posts from ten subreddits of five domains. In terms of the first approach, each post passes through a shared BERT layer, which is updated by both tasks. Next, two separate BERT encoder layers are exploited, which are updated by each task separately. Regarding the second approach, it consists of shared and task-specific layers weighted by attention fusion networks. We conduct a series of experiments and compare our approaches with existing research initiatives, single-task learning, and transfer learning. Experiments show multiple advantages of our approaches over state-of-the-art ones.
- Multitask learning: A knowledge-based source of inductive bias, in: Proceedings of the Tenth International Conference on International Conference on Machine Learning, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA. p. 41–48.
- Multitask learning. Machine learning 28, 41–75.
- Combining sentiment lexicons and content-based features for depression detection. IEEE Intelligent Systems 36, 99–105. doi:10.1109/MIS.2021.3093660.
- CLPsych 2015 shared task: Depression and PTSD on Twitter, in: Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality, Association for Computational Linguistics, Denver, Colorado. pp. 31–39. URL: https://aclanthology.org/W15-1204, doi:10.3115/v1/W15-1204.
- GoEmotions: A dataset of fine-grained emotions, in: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Online. pp. 4040–4054. URL: https://aclanthology.org/2020.acl-main.372, doi:10.18653/v1/2020.acl-main.372.
- Simsensei kiosk: A virtual human interviewer for healthcare decision support, in: Proceedings of the 2014 International Conference on Autonomous Agents and Multi-Agent Systems, International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC. p. 1061–1068.
- BERT: Pre-training of deep bidirectional transformers for language understanding, in: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Association for Computational Linguistics, Minneapolis, Minnesota. pp. 4171–4186. URL: https://aclanthology.org/N19-1423, doi:10.18653/v1/N19-1423.
- A multitask framework to detect depression, sentiment and multi-label emotion from suicide notes. Cognitive Computation , 1–20.
- What does your bio say? inferring twitter users’ depression status from multimodal profile information using deep learning. IEEE Transactions on Computational Social Systems 9, 1484–1494. doi:10.1109/TCSS.2021.3116242.
- The distress analysis interview corpus of human and computer interviews, in: Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC’14), European Language Resources Association (ELRA), Reykjavik, Iceland. pp. 3123–3128. URL: http://www.lrec-conf.org/proceedings/lrec2014/pdf/508_Paper.pdf.
- Deep learning for depression detection of Twitter users, in: Proceedings of the Fifth Workshop on Computational Linguistics and Clinical Psychology: From Keyboard to Clinic, Association for Computational Linguistics, New Orleans, LA. pp. 88–97. URL: https://aclanthology.org/W18-0609, doi:10.18653/v1/W18-0609.
- Explainable identification of dementia from transcripts using transformer networks. IEEE Journal of Biomedical and Health Informatics 26, 4153–4164. doi:10.1109/JBHI.2022.3172479.
- Calibration of transformer-based models for identifying stress and depression in social media. IEEE Transactions on Computational Social Systems , 1–12doi:10.1109/TCSS.2023.3283009.
- Complaint identification in social media with transformer networks, in: Proceedings of the 28th International Conference on Computational Linguistics, International Committee on Computational Linguistics, Barcelona, Spain (Online). pp. 1765–1771. URL: https://aclanthology.org/2020.coling-main.157, doi:10.18653/v1/2020.coling-main.157.
- Analyzing political parody in social media, in: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Online. pp. 4373–4384. URL: https://aclanthology.org/2020.acl-main.403, doi:10.18653/v1/2020.acl-main.403.
- Pytorch: An imperative style, high-performance deep learning library, in: Wallach, H., Larochelle, H., Beygelzimer, A., d'Alché-Buc, F., Fox, E., Garnett, R. (Eds.), Advances in Neural Information Processing Systems, Curran Associates, Inc. URL: https://proceedings.neurips.cc/paper/2019/file/bdbca288fee7f92f2bfa9f7012727740-Paper.pdf.
- Identifying depression on Reddit: The effect of training data, in: Proceedings of the 2018 EMNLP Workshop SMM4H: The 3rd Social Media Mining for Health Applications Workshop & Shared Task, Association for Computational Linguistics, Brussels, Belgium. pp. 9–12. URL: https://aclanthology.org/W18-5903, doi:10.18653/v1/W18-5903.
- Multi-level multiple attentions for contextual multimodal sentiment analysis, in: 2017 IEEE International Conference on Data Mining (ICDM), pp. 1033–1038. doi:10.1109/ICDM.2017.134.
- Improving depression level estimation by concurrently learning emotion intensity. IEEE Computational Intelligence Magazine 15, 47–59. doi:10.1109/MCI.2020.2998234.
- Multitask representation learning for multimodal estimation of depression level. IEEE Intelligent Systems 34, 45–52. doi:10.1109/MIS.2019.2925204.
- The psychology of word use in depression forums in english and in spanish: Testing two text analytic approaches. Proceedings of the International AAAI Conference on Web and Social Media 2, 102–108. URL: https://ojs.aaai.org/index.php/ICWSM/article/view/18623, doi:10.1609/icwsm.v2i1.18623.
- Depression detection on reddit with an emotion-based attention network: Algorithm development and validation. JMIR Med Inform 9, e28754. URL: https://medinform.jmir.org/2021/7/e28754, doi:10.2196/28754.
- Avec 2019 workshop and challenge: State-of-mind, detecting depression with ai, and cross-cultural affect recognition, in: Proceedings of the 9th International on Audio/Visual Emotion Challenge and Workshop, Association for Computing Machinery, New York, NY, USA. p. 3–12. URL: https://doi.org/10.1145/3347320.3357688, doi:10.1145/3347320.3357688.
- Predicting depression and anxiety on reddit: a multi-task learning approach, in: 2022 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), pp. 427–435. doi:10.1109/ASONAM55673.2022.10068655.
- Dac stacking: A deep learning ensemble to classify anxiety, depression, and their comorbidity from reddit texts. IEEE Journal of Biomedical and Health Informatics 26, 3303–3311. doi:10.1109/JBHI.2022.3151589.
- Detection of depression-related posts in reddit social media forum. IEEE Access 7, 44883–44893. doi:10.1109/ACCESS.2019.2909180.
- Dreaddit: A Reddit dataset for stress analysis in social media, in: Proceedings of the Tenth International Workshop on Health Text Mining and Information Analysis (LOUHI 2019), Association for Computational Linguistics, Hong Kong. pp. 97–107. URL: https://aclanthology.org/D19-6213, doi:10.18653/v1/D19-6213.
- Emotion-infused models for explainable psychological stress detection, in: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics, Online. pp. 2895–2909. URL: https://aclanthology.org/2021.naacl-main.230, doi:10.18653/v1/2021.naacl-main.230.
- Attention is all you need, in: Proceedings of the 31st International Conference on Neural Information Processing Systems, Curran Associates Inc., Red Hook, NY, USA. p. 6000–6010.
- Online social network individual depression detection using a multitask heterogenous modality fusion approach. Information Sciences 609, 727–749. URL: https://www.sciencedirect.com/science/article/pii/S002002552200799X, doi:https://doi.org/10.1016/j.ins.2022.07.109.
- Transformers: State-of-the-art natural language processing, in: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, Association for Computational Linguistics, Online. pp. 38–45. URL: https://www.aclweb.org/anthology/2020.emnlp-demos.6.
- Identifying depressive symptoms from tweets: Figurative language enabled multitask learning framework, in: Proceedings of the 28th International Conference on Computational Linguistics, International Committee on Computational Linguistics, Barcelona, Spain (Online). pp. 696–709. URL: https://aclanthology.org/2020.coling-main.61, doi:10.18653/v1/2020.coling-main.61.
- A mental state knowledge–aware and contrastive network for early stress and depression detection on social media. Information Processing & Management 59, 102961. URL: https://www.sciencedirect.com/science/article/pii/S0306457322000796, doi:https://doi.org/10.1016/j.ipm.2022.102961.
- Depression and self-harm risk assessment in online forums, in: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Copenhagen, Denmark. pp. 2968–2978. URL: https://aclanthology.org/D17-1322, doi:10.18653/v1/D17-1322.
- Multi-task learning for jointly detecting depression and emotion, in: 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 3142–3149. doi:10.1109/BIBM52615.2021.9669546.
- Health issue identification in social media based on multi-task hierarchical neural networks with topic attention. Artificial Intelligence in Medicine 118, 102119. URL: https://www.sciencedirect.com/science/article/pii/S0933365721001123, doi:https://doi.org/10.1016/j.artmed.2021.102119.