A Variational Approach to Privacy and Fairness

Autor: Ragnar Thobaben, Mikael Skoglund, Borja Rodríguez Gálvez
Rok vydání: 2020
Předmět:
Zdroj: ITW
DOI: 10.48550/arxiv.2006.06332
Popis: In this article, we propose a new variational approach to learn private and/or fair representations. This approach is based on the Lagrangians of a new formulation of the privacy and fairness optimization problems that we propose. In this formulation, we aim to generate representations of the data that keep a prescribed level of the relevant information that is not shared by the private or sensitive data, while minimizing the remaining information they keep. The proposed approach (i) exhibits the similarities of the privacy and fairness problems, (ii) allows us to control the trade-off between utility and privacy or fairness through the Lagrange multiplier parameter, and (iii) can be comfortably incorporated to common representation learning algorithms such as the VAE, the $\beta$-VAE, the VIB, or the nonlinear IB.
Comment: Accepted at the ITW 2021 conference. Previously presented at the PPAI-21 workshop from the AAAI-21 conference. Content distribution: 5 pages of main content + 2 pages of references + 11 pages of supplementary material
Databáze: OpenAIRE