An attention-based hybrid architecture with explainability for depressive social media text detection in Bangla

Mental health has become a major concern in recent years. Social media have been increasingly used as platforms to gain insight into a person’s mental health condition by analysing the posts and comments, which are textual in nature. By analysing these texts, depressive posts can be detected. To facilitate this process, this work presents an attention-based bidirectional Long Short-Term Memory (LSTM)- Convolutional Neural Network (CNN) based model to detect depressive Bangla social media texts, which is lighter and more robust than the conventional models and provides better performance. A dataset containing such Bangla texts was also developed in this work to mitigate the scarcity. Different preprocessing stages were followed, and three embeddings were used in this task. Thanks to the attention mechanism, the proposed model achieved an accuracy of 94.3% with 92.63% of sensitivity and 95.12% of specificity. When tested on other languages, such as English, the proposed model performed remarkably. The robustness and explainability of the proposed model were also discussed in this paper. Additionally, when compared with classical machine learning models, ensemble approaches, transformers, other similar models, and existing architectures, the proposed model outperformed them.