Addressing Regulatory Requirements on Explanations for Automated Decisions with Provenance—A Case Study
Autor: | Luc Moreau, Niko Tsakalakis, Trung Dong Huynh, Sophie Stalla-Bourdillon, Ayah Helal |
---|---|
Rok vydání: | 2021 |
Předmět: |
explainable computing
Public Administration Computer Networks and Communications Computer science 05 social sciences data provenance 020207 software engineering 02 engineering and technology 050905 science studies Data science Pipeline (software) Computer Science Applications Whole systems Variety (cybernetics) automated decisions Work (electrical) Audit trail Loan 0202 electrical engineering electronic engineering information engineering Lower cost GDPR 0509 other social sciences Software Information Systems |
Zdroj: | Huynh, T D, Tsakalakis, N, Helal, A, Stalla-Bourdillon, S & Moreau, L 2021, ' Addressing Regulatory Requirements on Explanations for Automated Decisions with Provenance : A Case Study ', Digital Government: Research and Practice, vol. 2, no. 2, 16e . https://doi.org/10.1145/3436897 |
ISSN: | 2639-0175 2691-199X |
DOI: | 10.1145/3436897 |
Popis: | AI-based automated decisions are increasingly used as part of new services being deployed to the general public. This approach to building services presents significant potential benefits, such as the reduced speed of execution, increased accuracy, lower cost, and ability to adapt to a wide variety of situations. However, equally significant concerns have been raised and are now well documented such as concerns about privacy, fairness, bias, and ethics. On the consumer side, more often than not, the users of those services are provided with no or inadequate explanations for decisions that may impact their lives. In this article, we report the experience of developing a socio-technical approach to constructing explanations for such decisions from their audit trails, or provenance, in an automated manner. The work has been carried out in collaboration with the UK Information Commissioner’s Office. In particular, we have implemented an automated Loan Decision scenario, instrumented its decision pipeline to record provenance, categorized relevant explanations according to their audience and their regulatory purposes, built an explanation-generation prototype, and deployed the whole system in an online demonstrator. |
Databáze: | OpenAIRE |
Externí odkaz: |