Getting Playful with Explainable AI: Games with a Purpose to Improve Human Understanding of AI
| Autor: | Zhendong Yuan, Jessica Hammer, Laura Beth Fulton, Qian Wang, Ja Young Lee, Adam Perer |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
Computer science
business.industry Deep learning 05 social sciences ComputingMilieux_PERSONALCOMPUTING 020207 software engineering 02 engineering and technology Data science Transparency (behavior) Scale (social sciences) 0202 electrical engineering electronic engineering information engineering 0501 psychology and cognitive sciences Artificial intelligence Empirical evidence business 050107 human factors Anecdotal evidence Criminal justice |
| Zdroj: | CHI Extended Abstracts |
| Popis: | Explainable Artificial Intelligence (XAI) is an emerging topic in Machine Learning (ML) that aims to give humans visibility into how AI systems make decisions. XAI is increasingly important in bringing transparency to fields such as medicine and criminal justice where AI informs high consequence decisions. While many XAI techniques have been proposed, few have been evaluated beyond anecdotal evidence. Our research offers a novel approach to assess how humans interpret AI explanations; we explore this by integrating XAI with Games with a Purpose (GWAP). XAI requires human evaluation at scale, and GWAP can be used for XAI tasks which are presented through rounds of play. This paper outlines the benefits of GWAP for XAI, and demonstrates application through our creation of a multi-player GWAP that focuses on explaining deep learning models trained for image recognition. Through our game, we seek to understand how humans select and interpret explanations used in image recognition systems, and bring empirical evidence on the validity of GWAP designs for XAI. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|