Data Augmentation in Histopathological Classification: An Analysis Exploring GANs with XAI and Vision Transformers

Autor: Guilherme Botazzo Rozendo, Bianca Lançoni de Oliveira Garcia, Vinicius Augusto Toreli Borgue, Alessandra Lumini, Thaína Aparecida Azevedo Tosta, Marcelo Zanchetta do Nascimento, Leandro Alves Neves
Jazyk: angličtina
Rok vydání: 2024
Předmět:
Zdroj: Applied Sciences, Vol 14, Iss 18, p 8125 (2024)
Druh dokumentu: article
ISSN: 2076-3417
DOI: 10.3390/app14188125
Popis: Generative adversarial networks (GANs) create images by pitting a generator (G) against a discriminator (D) network, aiming to find a balance between the networks. However, achieving this balance is difficult because G is trained based on just one value representing D’s prediction, and only D can access image features. We introduce a novel approach for training GANs using explainable artificial intelligence (XAI) to enhance the quality and diversity of generated images in histopathological datasets. We leverage XAI to extract feature information from D and incorporate it into G via the loss function, a unique strategy not previously explored in this context. We demonstrate that this approach enriches the training with relevant information and promotes improved quality and more variability in the artificial images, decreasing the FID by up to 32.7% compared to traditional methods. In the data augmentation task, these images improve the classification accuracy of Transformer models by up to 3.81% compared to models without data augmentation and up to 3.01% compared to traditional GAN data augmentation. The Saliency method provides G with the most informative feature information. Overall, our work highlights the potential of XAI for enhancing GAN training and suggests avenues for further exploration in this field.
Databáze: Directory of Open Access Journals