CERTIFAI
| Autor: | Joydeep Ghosh, Jette Henderson, Shubham Sharma |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
Counterfactual thinking
Artificial Intelligence System Computer science business.industry 02 engineering and technology Common framework Machine learning computer.software_genre Key issues Bottleneck Robustness (computer science) 020204 information systems 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Artificial intelligence business computer |
| Zdroj: | AIES |
| DOI: | 10.1145/3375627.3375812 |
| Popis: | Concerns within the machine learning community and external pressures from regulators over the vulnerabilities of machine learning algorithms have spurred on the fields of explainability, robustness, and fairness. Often, issues in explainability, robustness, and fairness are confined to their specific sub-fields and few tools exist for model developers to use to simultaneously build their modeling pipelines in a transparent, accountable, and fair way. This can lead to a bottleneck on the model developer's side as they must juggle multiple methods to evaluate their algorithms. In this paper, we present a single framework for analyzing the robustness, fairness, and explainability of a classifier. The framework, which is based on the generation of counterfactual explanations through a custom genetic algorithm, is flexible, model-agnostic, and does not require access to model internals. The framework allows the user to calculate robustness and fairness scores for individual models and generate explanations for individual predictions which provide a means for actionable recourse (changes to an input to help get a desired outcome). This is the first time that a unified tool has been developed to address three key issues pertaining towards building a responsible artificial intelligence system. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|