Generating visual explanations with natural language

Autor: Lisa Anne Hendricks, Anna Rohrbach, Bernt Schiele, Trevor Darrell, Zeynep Akata
Jazyk: angličtina
Rok vydání: 2021
Předmět:
Zdroj: Applied AI Letters, Vol 2, Iss 4, Pp n/a-n/a (2021)
Druh dokumentu: article
ISSN: 2689-5595
DOI: 10.1002/ail2.55
Popis: Abstract We generate natural language explanations for a fine‐grained visual recognition task. Our explanations fulfill two criteria. First, explanations are class discriminative, meaning they mention attributes in an image which are important to identify a class. Second, explanations are image relevant, meaning they reflect the actual content of an image. Our system, composed of an explanation sampler and phrase‐critic model, generates class discriminative and image relevant explanations. In addition, we demonstrate that our explanations can help humans decide whether to accept or reject an AI decision.
Databáze: Directory of Open Access Journals