An Analysis of Regularized Approaches for Constrained Machine Learning

Autor: Michela Milano, Andrea Borghesi, Federico Baldo, Michele Lombardi
Přispěvatelé: Heintz F., Milano M., O'Sullivan B., Lombardi, Michele, Baldo, Federico, Borghesi, Andrea, Milano, Michela
Jazyk: angličtina
Rok vydání: 2020
Předmět:
Zdroj: Trustworthy AI-Integrating Learning, Optimization and Reasoning ISBN: 9783030739584
TAILOR
DOI: 10.5281/zenodo.3944312
Popis: Regularization-based approaches for injecting constraints in Machine Learning (ML) were introducedto improve a predictive model via expert knowledge. Given the recent interest in ethical and trustworthy AI, however, several works are resorting to these approaches for the (conceptually different) task of enforcing desired properties over a ML model, e.g. fairness. When regularized methods are used to enforce constraints, a typical approach consists in adjusting the regularizer multipliersuntil a suitable compromise between accuracy and constraint satisfaction is reached(e.g. a discrimination index becomes sufficiently low). This approach enables the use of traditional training algorithms, at the cost of having to search over the space of possible multipliers.Though the method is known to work well in many practical cases, the process has been subject to little general analysis. With this note, we make a preliminary step in this direction, providing a more systematic overview of the strengths and (in particular) potential weaknesses of this class of approaches.  
Databáze: OpenAIRE