TABAS: Text augmentation based on attention score for text classification model

Autor: Yeong Jae Yu, Seung Joo Yoon, So Young Jun, Jong Woo Kim
Jazyk: angličtina
Rok vydání: 2022
Předmět:
Zdroj: ICT Express, Vol 8, Iss 4, Pp 549-554 (2022)
Druh dokumentu: article
ISSN: 2405-9595
DOI: 10.1016/j.icte.2021.11.002
Popis: To improve the performance of text classification, we propose text augmentation based on attention score (TABAS). We recognized that a criterion for selecting a replacement word rather than a random selection was necessary. Therefore, TABAS utilizes attention scores for text modification, processing only words with the same entity and part-of-speech tags to consider informational aspects. To verify this approach, we used two benchmark tasks. As a result, TABAS can significantly improve performance, both recurrent and convolutional neural networks. Furthermore, we confirm that it provides a practical way to develop deep-learning models by saving costs on making additional datasets.
Databáze: Directory of Open Access Journals