Amazing technological breakthrough possible @S-Logix

Office Address

  • #5, First Floor, 4th Street Dr. Subbarayan Nagar Kodambakkam, Chennai-600 024 Landmark : Samiyar Madam
  • +91- 81240 01111

Social List

State Graph Reasoning for Multimodal Conversational Recommendation - 2022

State Graph Reasoning For Multimodal Conversational Recommendation

Research Paper on State Graph Reasoning For Multimodal Conversational Recommendation

Research Area:  Machine Learning


Conversational recommendation system (CRS) attracts increasing attention in various application domains such as retail and travel. It offers an effective way to capture users dynamic preferences with multi-turn conversations. However, most current studies center on the recommendation aspect while over-simplifying the conversation process. The negligence of complexity in data structure and conversation flow hinders their practicality and utility. In reality, there exist various relationships among slots and values, while users requirements may dynamically adjust or change. Moreover, the conversation often involves visual modality to facilitate the conversation. These actually call for a more advanced internal state representation of the dialogue and a proper reasoning scheme to guide the decision making process. In this paper, we explore multiple facets of multimodal conversational recommendation and try to address the above mentioned challenges. In particular, we represent the structured back-end database as a multimodal knowledge graph which captures the various relations and evidence in different modalities. The user preferences expressed via conversation utterances will then be gradually updated to the state graph with clear polarity. Based on these, we train an end-to-end State Graph-based Reasoning model SGR to perform reasoning over the whole state graph. The prediction of our proposed model benefits from the structure of the graph. It not only allows for zero-shot reasoning for items unseen in training conversations, but also provides a natural way to explain the policies. Extensive experiments show that our model achieves better performance compared with existing methods.

Graph Reasoning
Conversational Recommendation
Deep Learning
Machine Learning

Author(s) Name:  Yuxia Wu; Lizi Liao; Gangyi Zhang; Wenqiang Lei; Guoshuai Zhao; Xueming Qian; Tat-Seng Chua

Journal name:   IEEE Transactions on Multimedia ( Early Access )

Conferrence name:  

Publisher name:  IEEE

DOI:  10.1109/TMM.2022.3155900

Volume Information:  Page(s): 1 - 1