Research Area:  Machine Learning
The research of comprehension of machine learning algorithms and procedures suitable for both image processing and natural language processing. The accommodation with existing packages used in implementing machine learning algorithms. The implementation of an algorithm that takes an image and describes it in comprehensive sentences. After the analyzed requirements, a bibliographic study was conducted for familiarization with the domain and possible models. Next, a study of the available technologies which would help to build the application was made, and then the design, implementation, and validation of the solution began. This paper presents a composite model, consisting of a deep convolutional neural network for feature extraction that makes use of transfer learning, and a recurrent neural network for building the descriptions. Keras with TensorFlow backend is used for implementation. A trained model that describes images using natural language was obtained.
Keywords:  
Author(s) Name:  Adela Puscasiu; Alexandra Fanca; Dan-Ioan Gota; Honoriu Valean
Journal name:  
Conferrence name:  IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR)
Publisher name:  IEEE
DOI:  10.1109/AQTR49680.2020.9129930
Volume Information:  
Paper Link:   https://ieeexplore.ieee.org/abstract/document/9129930