Bangla language textual image description by hybrid neural network model
| Autor: | Abul Kalam Al Azad, Bijan Paul, Khan Raqib Mahmud, Md. Shahabub Alam, Md. Asifuzzaman Jishan, Mohammad Rifat Ahmmad Rashid |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2021 |
| Předmět: |
Closed captioning
Control and Optimization Computer Networks and Communications Computer science Semantic interpretation Bangla natural language descriptors ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION Convolutional neural network computer.software_genre Hybrid neural network Electrical and Electronic Engineering business.industry Hybrid recurrent neural network language.human_language Bengali Hardware and Architecture Signal Processing Benchmark (computing) language Embedding Artificial intelligence business computer Encoder Natural language processing Natural language Sentence Information Systems Long short-term memory bidirectional recurrent neural network |
| Popis: | Automatic image captioning task in different language is a challenging task which has not been well investigated yet due to the lack of dataset and effective models. It also requires good understanding of scene and contextual embedding for robust semantic interpretation of images for natural language image descriptor. To generate image descriptor in Bangla, we created a new Bangla dataset of images paired with target language label, named as Bangla Natural Language Image to Text (BNLIT) dataset. To deal with the image understanding, we propose a hybrid encoder-decoder model based on encoder-decoder architecture and the model is evaluated on our newly created dataset. This proposed approach achieves significance performance improvement on task of semantic retrieval of images. Our hybrid model uses the Convolutional NeuralNetwork as an encoder whereas the Bidirectional Long Short Term Memory is used for the sentence representation that decreases the computational complexities without trading off the exactness of the descriptor. The model yielded benchmark accuracy in recovering Bangla natural language and we also conducted a thorough numerical analysis of the model performance on the BNLIT dataset. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|