Research Area:  Machine Learning

Abstract:

Currently, no social media platform has deployed a real time system which can analyse users state of mind based on day to day posts on continual basis and detect the onset of depression, suicidal or self harming behaviour etc. Platforms majorly rely on manual reporting of suicidal and self harming behavior. In this paper, we propose a real time, deep learning based system for affective analysis of a user-s online social media posts of multimodal nature, with the objective of detecting onset of depression and suicidal or self harming behaviour; as depression often drives people to commit suicide or harm themselves physically.Joint representations are obtained by fusing the individual vector representations of multiple modalities from user-s social media feed: text, image and videos. These vector representations are in turn obtained through state of the art approaches for each modality e.g. VGG-16 for feature extraction from images, word2vec for text and Faster R-CNN on video frames. These joint representations are used to obtain weighted average score which can be used for making the final classification using the Softmax prediction layer.To the best of our knowledge, this is the first research where the use of deep learning techniques has been proposed for real time detection of onset of depression and suicidal behaviour by analysing multimodal user generated content.

Keywords:  

Author(s) Name:  Anshu Malhotra, Rajni Jindal

Publisher name:  EAI

DOI:  10.4108/eai.13-7-2018.164259

Volume Information:  Volume 6 , Issue 21

Paper Link:   https://eudl.eu/doi/10.4108/eai.13-7-2018.164259