Differentially Private Generative Adversarial Networks with Model Inversion

Autor: Chen, Dongjie, Cheung, Sen-ching Samson, Chuah, Chen-Nee, Ozonoff, Sally
Rok vydání: 2022
Předmět:
Druh dokumentu: Working Paper
DOI: 10.1109/WIFS53200.2021.9648378
Popis: To protect sensitive data in training a Generative Adversarial Network (GAN), the standard approach is to use differentially private (DP) stochastic gradient descent method in which controlled noise is added to the gradients. The quality of the output synthetic samples can be adversely affected and the training of the network may not even converge in the presence of these noises. We propose Differentially Private Model Inversion (DPMI) method where the private data is first mapped to the latent space via a public generator, followed by a lower-dimensional DP-GAN with better convergent properties. Experimental results on standard datasets CIFAR10 and SVHN as well as on a facial landmark dataset for Autism screening show that our approach outperforms the standard DP-GAN method based on Inception Score, Fr\'echet Inception Distance, and classification accuracy under the same privacy guarantee.
Comment: Best Student Paper Award of 13th IEEE International Workshop on Information Forensics and Security (WIFS 2021), Montpellier, France
Databáze: arXiv