Execute Order 66: Targeted Data Poisoning for Reinforcement Learning

Autor:	Foley, Harrison, Fowl, Liam, Goldstein, Tom, Taylor, Gavin
Rok vydání:	2022
Předmět:	Computer Science - Machine Learning Computer Science - Artificial Intelligence Computer Science - Cryptography and Security
Druh dokumentu:	Working Paper
Popis:	Data poisoning for reinforcement learning has historically focused on general performance degradation, and targeted attacks have been successful via perturbations that involve control of the victim's policy and rewards. We introduce an insidious poisoning attack for reinforcement learning which causes agent misbehavior only at specific target states - all while minimally modifying a small fraction of training observations without assuming any control over policy or reward. We accomplish this by adapting a recent technique, gradient alignment, to reinforcement learning. We test our method and demonstrate success in two Atari games of varying difficulty. Comment: Workshop on Safe and Robust Control of Uncertain Systems at the 35th Conference on Neural Information Processing Systems
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/2201.00762 Zobrazit plný text záznamu View this record from Arxiv