Amazing technological breakthrough possible @S-Logix

Office Address

  • #5, First Floor, 4th Street Dr. Subbarayan Nagar Kodambakkam, Chennai-600 024 Landmark : Samiyar Madam
  • +91- 81240 01111

Social List

Multimodal Deep Learning based Framework for Detecting Depression and Suicidal Behaviour by Affective Analysis of Social Media Posts - 2020

Multimodal Deep Learning Based Framework For Detecting Depression And Suicidal Behaviour By Affective Analysis Of Social Media Posts

Research Area:  Machine Learning


Currently, no social media platform has deployed a real time system which can analyse users state of mind based on day to day posts on continual basis and detect the onset of depression, suicidal or self harming behaviour etc. Platforms majorly rely on manual reporting of suicidal and self harming behavior. In this paper, we propose a real time, deep learning based system for affective analysis of a user-s online social media posts of multimodal nature, with the objective of detecting onset of depression and suicidal or self harming behaviour; as depression often drives people to commit suicide or harm themselves physically.Joint representations are obtained by fusing the individual vector representations of multiple modalities from user-s social media feed: text, image and videos. These vector representations are in turn obtained through state of the art approaches for each modality e.g. VGG-16 for feature extraction from images, word2vec for text and Faster R-CNN on video frames. These joint representations are used to obtain weighted average score which can be used for making the final classification using the Softmax prediction layer.To the best of our knowledge, this is the first research where the use of deep learning techniques has been proposed for real time detection of onset of depression and suicidal behaviour by analysing multimodal user generated content.


Author(s) Name:  Anshu Malhotra, Rajni Jindal

Journal name:  European Union Digital Library

Conferrence name:  

Publisher name:  EAI

DOI:  10.4108/eai.13-7-2018.164259

Volume Information:  Volume 6 , Issue 21