Abstract
Depression is one of the most prominent mental health issues, characterized by a depressed low mood and an absence of enthusiasm in activities. In terms of early detection, accurate diagnosis, and effective treatment, doctors face a serious challenge from depression, which is a serious global health issue. For patients with this mental disease to receive prompt medical attention and improve their general well-being, early identification is essential. For the purpose of detecting various psychological illnesses including depression, anxiety, and post-traumatic stress disorder, medical audio consultations along with survey responses have been used. A depressed individual displays a range of subtle signs that may be more easily identified by combining the results of multiple modalities. Multimodality involves extracting maximum information from data by using multiple modes, so that the deep learning model can be trained efficiently to give better results. Given that each modality functions differently, combining various modalities is not easy, and each origin of a modality takes on a different form. It is clear from the literature that is currently significant in the area that, combining the modalities yields positive outcomes. A trustworthy approach to identify depression is thus urgently needed because it continues to be a problem for many individuals in today’s society. In this work, textual and audio features are incorporated related to the identification of depression, and a novel multimodal approach using an optimized Bi-directional Long Short -Term Memory model that recognizes premature depression is suggested for medical intervention before it develops further.
References
World Health Organization. (n.d.). Depression. World Health Organization. Retrieved October 15, 2022, from https://www.who.int/news-room/fact-sheets/detail/depression
Mathers, C.D., & Lončar, D. (2006). Projections of Global Mortality and Burden of Disease from 2002 to 2030. PLoS Medicine, 3.
World Health Organization. (n.d.). Suicide. World Health Organization. Retrieved October 15, 2022, from https://www.who.int/news-room/fact-sheets/detail/suicide
World Health Organization. (n.d.). Preventing suicide: A global imperative. World Health Organization. Retrieved October 15, 2022, from https://www.who.int/publications/i/item/9789241564779
Harvard Health. (2020, October 13). Six common depression types. https://www.health.harvard.edu/mind-and-mood/six-common-depression-types
Pacis, D.M., Subido, E.D., & Bugtai, N.T. (2018). Trends in telemedicine utilizing artificial intelligence.
Gandhi, P.A., & Kishore, J. (2020). Prevalence of depression and the associated factors among the software professionals in Delhi: A cross-sectional study. Indian Journal of Public Health, 64, 413 - 416.
Li, X., La, R., Wang, Y., Hu, B., & Zhang, X. (2020). A Deep Learning Approach for Mild Depression Recognition Based on Functional Connectivity Using Electroencephalography. Frontiers in Neuroscience, 14.
World Health Organization. (n.d.). Covid-19 pandemic triggers 25% increase in prevalence of anxiety and depression worldwide. World Health Organization. Retrieved October 19, 2022, from https://www.who.int/news/item/02-03-2022-covid-19-pandemic-triggers-25-increase-in-prevalence-of-anxiety-and-depression-worldwide
Kipli, K., Kouzani, A.Z., & Hamid, I.R. (2013). Investigating machine learning techniques for detection of depression using structural MRI volumetric features. International Journal of Bioscience, Biochemistry and Bioinformatics, 3, 444-448.
Chatterjee, R., Gupta, R.K., & Gupta, B. (2021). Depression Detection from Social Media Posts Using Multinomial Naive Theorem. IOP Conference Series: Materials Science and Engineering, 1022.
Chiu, C., Lane, H., Koh, J., & Chen, A.L. (2020). Multimodal depression detection on instagram considering time interval of posts. Journal of Intelligent Information Systems, 56, 25-47.
Kerestes, R., Davey, C.G., Stephanou, K., Whittle, S., & Harrison, B.J. (2014). Functional brain imaging studies of youth depression: A systematic review☆. NeuroImage : Clinical, 4, 209 - 231.
Patel, M.J., Khalaf, A.M., & Aizenstein, H.J. (2016). Studying depression using imaging and machine learning methods. NeuroImage : Clinical, 10, 115 - 123.
Kipli, K., Kouzani, A.Z., & Williams, L.J. (2013). Towards automated detection of depression from brain structural magnetic resonance images. Neuroradiology, 55, 567-584.
Cohen, S.E., Zantvoord, J.B., Wezenberg, B.N., Bockting, C.L., & van Wingen, G.A. (2021). Magnetic resonance imaging for individual prediction of treatment response in major depressive disorder: a systematic review and meta-analysis. Translational Psychiatry, 11.
Binnewies, J., Nawijn, L., Tol, M.V., Wee, N.J., Veltman, D.J., & Penninx, B. (2021). Associations between depression, lifestyle and brain structure: A longitudinal MRI study. NeuroImage, 231.
Wang, Z., Yuan, Y., Jiang, Y., You, J., & Zhang, Z. (2021). Identification of specific neural circuit underlying the key cognitive deficit of remitted late-onset depression: A multi-modal MRI and machine learning study. Progress in Neuro-Psychopharmacology and Biological Psychiatry, 108.
Yoshida, K., Shimizu, Y., Yoshimoto, J., Takamura, M., Okada, G., Okamoto, Y., Yamawaki, S., & Doya, K. (2017). Prediction of clinical depression scores and detection of changes in whole-brain using resting-state functional MRI data with partial least squares regression. PLoS ONE, 12.
Uddin, M.Z., Dysthe, K.K., Følstad, A., & Brandtzaeg, P.B. (2022). Deep learning for prediction of depressive symptoms in a large textual dataset. Neural Computing and Applications, 34, 721-744.
Mousavian, M., Chen, J., & Greening, S.G. (2020). Depression Detection Using Atlas from fMRI Images. 2020 19th IEEE International Conference on Machine Learning and Applications (ICMLA), 1348-1353.
Sanyal, H., Shukla, S., & Agrawal, R. (2021). Study of Depression Detection using Deep Learning. 2021 IEEE International Conference on Consumer Electronics (ICCE), 1-5.
Solieman, H., & Pustozerov, E.A. (2021). The Detection of Depression Using Multimodal Models Based on Text and Voice Quality Features. 2021 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (ElConRus), 1843-1848.
Ceccarelli, F., & Mahmoud, M.M. (2022). Multimodal temporal machine learning for Bipolar Disorder and Depression Recognition. Pattern Anal. Appl., 25, 493-504.
Gratch, J., Artstein, R., Lucas, G.M., Stratou, G., Scherer, S., Nazarian, A., Wood, R., Boberg, J., DeVault, D., Marsella, S., Traum, D.R., Rizzo, A.A., & Morency, L. (2014). The Distress Analysis Interview Corpus of human and computer interviews. LREC.
Mathers, C.D., & Lončar, D. (2006). Projections of Global Mortality and Burden of Disease from 2002 to 2030. PLoS Medicine, 3.
Morency, L. P., Stratou, G., DeVault, D., Hartholt, A., Lhommet, M., Lucas, G., ... & Rizzo, A. (2015, March). SimSensei demonstration: a perceptive virtual human interviewer for healthcare applications. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 29, No. 1).