Research Area:  Machine Learning

Abstract:

Image captioning is a hot topic of image understanding, and it is composed of two natural parts (“look” and “language expression”) which correspond to the two most important fields of artificial intelligence (“machine vision” and “natural language processing”). With the development of deep neural networks and better labeling database, the image captioning techniques have developed quickly. In this survey, the image captioning approaches and improvements based on deep neural network are introduced, including the characteristics of the specific techniques. The early image captioning approach based on deep neural network is the retrieval-based method. The retrieval method makes use of a searching technique to find an appropriate image description. The template-based method separates the image captioning process into object detection and sentence generation. Recently, end-to-end learning-based image captioning method has been verified effective at image captioning. The end-to-end learning techniques can generate more flexible and fluent sentence. In this survey, the image captioning methods are reviewed in detail. Furthermore, some remaining challenges are discussed.

Keywords:  

Author(s) Name:  Xiaoxiao Liu, Qingyang Xu & Ning Wang

Publisher name:  Springer

DOI:  10.1007/s00371-018-1566-y

Volume Information:  volume 35, pages: 445–470 (2019)

Paper Link:   https://link.springer.com/article/10.1007/s00371-018-1566-y