Sphynx: ReLU-Efficient Network Design for Private Inference

Autor: Cho, Minsu, Ghodsi, Zahra, Reagen, Brandon, Garg, Siddharth, Hegde, Chinmay
Rok vydání: 2021
Předmět:
Zdroj: IEEE Security & Privacy, vol. 20, no. 05, pp. 22-34, 2022
Druh dokumentu: Working Paper
DOI: 10.1109/MSEC.2022.3165475
Popis: The emergence of deep learning has been accompanied by privacy concerns surrounding users' data and service providers' models. We focus on private inference (PI), where the goal is to perform inference on a user's data sample using a service provider's model. Existing PI methods for deep networks enable cryptographically secure inference with little drop in functionality; however, they incur severe latency costs, primarily caused by non-linear network operations (such as ReLUs). This paper presents Sphynx, a ReLU-efficient network design method based on micro-search strategies for convolutional cell design. Sphynx achieves Pareto dominance over all existing private inference methods on CIFAR-100. We also design large-scale networks that support cryptographically private inference on Tiny-ImageNet and ImageNet.
Databáze: arXiv