Amazing technological breakthrough possible @S-Logix

Office Address

  • #5, First Floor, 4th Street Dr. Subbarayan Nagar Kodambakkam, Chennai-600 024 Landmark : Samiyar Madam
  • +91- 81240 01111

Social List

An Attentive Survey of Attention Models - 2021

An Attentive Survey Of Attention Models

Research Area:  Machine Learning


Attention Model has now become an important concept in neural networks that has been researched within diverse application domains. This survey provides a structured and comprehensive overview of the developments in modeling attention. In particular, we propose a taxonomy that groups existing techniques into coherent categories. We review salient neural architectures in which attention has been incorporated and discuss applications in which modeling attention has shown a significant impact. We also describe how attention has been used to improve the interpretability of neural networks. Finally, we discuss some future research directions in attention. We hope this survey will provide a succinct introduction to attention models and guide practitioners while developing approaches for their applications.


Author(s) Name:  Sneha Chaudhari , Varun Mithal , Gungor Polatkan , Rohan Ramanath

Journal name:  ACM Transactions on Intelligent Systems and Technology

Conferrence name:  

Publisher name:  ACM

DOI:  10.1145/3465055

Volume Information:  Volume 12,Issue 5,October 2021, Article No.: 53,pp 1–32