Image Captioning using Deep Learning for the Visually Impaired

Autor: Dr. A. M. Chandrashekhar
Rok vydání: 2021
Předmět:
Zdroj: International Journal for Research in Applied Science and Engineering Technology. 9:517-522
ISSN: 2321-9653
DOI: 10.22214/ijraset.2021.36267
Popis: Describing the content of an image has been a fundamental problem of Machine learning that connects computer vision and natural language processing. In recent years, the task of object recognition has advanced at an exceptional rate which in turn has made image captioning that much better and easier. In this paper, we have discussed the usage of image captioning using deep learning for the visually impaired. We have used Convolutional Neural Networks along with Long Short-Term Memory to train and generate captions for images along with a text-to-speech engine which makes the experience of visually impaired users who are browsing the internet much smoother. We discuss how the model was implemented, its different components and modules along with a result analysis conducted on a set of outputs peer reviewed by our colleagues, friends and professors.
Databáze: OpenAIRE