Research Area:  Machine Learning

Abstract:

Automatically understanding the content of medical images and delivering accurate descriptions is an emerging field of artificial intelligence that combines skills in both computer vision and natural language processing fields. Medical image captioning is involved in various applications related to diagnosis, treatment, report generation and computer-aided diagnosis to facilitate the decision making and clinical workflows. Unlike generic image captioning, medical image captioning highlights the relationships between image objects and clinical findings, which makes it a very challenging task. Although few review papers have already been published in this field, their coverage is still quite limited and only particular problems are addressed. This motivates the current paper where a rapid review protocol was adopted to review the latest achievements in automatic medical image captioning from the medical domain perspective. We aim through this review to provide the reader with an up-to-date literature in this field by summarizing the key findings and approaches in this field, including the related datasets, applications and limitations as well as highlighting the main competitions, challenges and future directions.

Keywords:  
Automatic image captioning
Diagnosis generation
Medical images
artificial intelligence
Report generation
PRISMA
Machine Learning
Deep Learning

Author(s) Name:  Djamila-Romaissa Beddiar, Mourad Oussalah & Tapio Seppänen

Publisher name:  Springer

DOI:  10.1007/s10462-022-10270-w

Volume Information:  

Paper Link:   https://link.springer.com/article/10.1007/s10462-022-10270-w