Research Area:  Machine Learning

Abstract:

The new era of technology has brought us to the point where it is convenient for people to share their opinions over an abundance of platforms. These platforms have a provision for the users to express themselves in multiple forms of representations, including text, images, videos, and audio. This, however, makes it difficult for users to obtain all the key information about a topic, making the task of automatic multi-modal summarization (MMS) essential. In this article, we present a comprehensive survey of the existing research in the area of MMS, covering various modalities such as text, image, audio, and video. Apart from highlighting the different evaluation metrics and datasets used for the MMS task, our work also discusses the current challenges and future directions in this field.

Keywords:  
text
images
videos
audio
utomatic multi-modal summarization
evaluation metrics
datasets

Author(s) Name:  Anubhav Jangra, Sourajit Mukherjee, Adam Jatowt, Sriparna Saha, Mohammad Hasanuzzaman

Publisher name:  ACM

DOI:  https://doi.org/10.1145/3584700

Volume Information:  Volume 55

Paper Link: https://dl.acm.org/doi/abs/10.1145/3584700