Model inversion attacks against collaborative inference
| Autor: | Zecheng He, Tianwei Zhang, Ruby B. Lee |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
021110 strategic
defence & security studies Information privacy Artificial neural network business.industry Computer science Deep learning 0211 other engineering and technologies Inference 02 engineering and technology Adversary Machine learning computer.software_genre Task (project management) 020204 information systems 0202 electrical engineering electronic engineering information engineering Collaboration Artificial intelligence business Set (psychology) computer |
| Zdroj: | ACSAC |
| DOI: | 10.1145/3359789.3359824 |
| Popis: | The prevalence of deep learning has drawn attention to the privacy protection of sensitive data. Various privacy threats have been presented, where an adversary can steal model owners' private data. Meanwhile, countermeasures have also been introduced to achieve privacy-preserving deep learning. However, most studies only focused on data privacy during training, and ignored privacy during inference. In this paper, we devise a new set of attacks to compromise the inference data privacy in collaborative deep learning systems. Specifically, when a deep neural network and the corresponding inference task are split and distributed to different participants, one malicious participant can accurately recover an arbitrary input fed into this system, even if he has no access to other participants' data or computations, or to prediction APIs to query this system. We evaluate our attacks under different settings, models and datasets, to show their effectiveness and generalization. We also study the characteristics of deep learning models that make them susceptible to such inference privacy threats. This provides insights and guidelines to develop more privacy-preserving collaborative systems and algorithms. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|