BEEF: Balanced English Explanations of Forecasts
| Autor: | Sachin Grover, V. S. Subrahmanian, Chiara Pulice, Gerardo I. Simari |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2019 |
| Předmět: |
KNOWLEDGE ENGINEERING
Decision support system Computer science Knowledge engineering 02 engineering and technology Machine learning computer.software_genre 01 natural sciences Data modeling 0103 physical sciences 0202 electrical engineering electronic engineering information engineering 010306 general physics business.industry 4. Education Ciencias de la Computación Human-Computer Interaction DECISION SUPPORT SYSTEMS Prediction algorithms Modeling and Simulation Ciencias de la Computación e Información 020201 artificial intelligence & image processing Artificial intelligence MACHINE LEARNING business Classifier (UML) computer Social Sciences (miscellaneous) Natural language CIENCIAS NATURALES Y EXACTAS |
| Popis: | The problem of understanding the reasons behind why different machine learning classifiers make specific predictions is a difficult one, mainly because the inner workings of the algorithms underlying such tools are not amenable to the direct extraction of succinct explanations. In this paper, we address the problem of automatically extracting balanced explanations from predictions generated by any classifier, which include not only why the prediction might be correct but also why it could be wrong. Our framework, called Balanced English Explanations of Forecasts, can generate such explanations in natural language. After showing that the problem of generating explanations is NP-complete, we focus on the development of a heuristic algorithm, empirically showing that it produces high-quality results both in terms of objective measures - with statistically significant effects shown for several parameter variations - and subjective evaluations based on a survey completed by 100 anonymous participants recruited via Amazon Mechanical Turk. Fil: Grover, Sachin. University of Carnegie Mellon; Estados Unidos Fil: Pulice, Chiara. Dartmouth College; Estados Unidos Fil: Simari, Gerardo. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Bahía Blanca. Instituto de Ciencias e Ingeniería de la Computación. Universidad Nacional del Sur. Departamento de Ciencias e Ingeniería de la Computación. Instituto de Ciencias e Ingeniería de la Computación; Argentina Fil: Subrahmanian, Venkatramanan. Dartmouth College; Estados Unidos |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|