Stackelberg Punishment and Bully-Proofing Autonomous Vehicles

Autor: Michael Gillett, Joshua D. Fishman, Michael L. Littman, Zoe Papakipos, Matt Cooper, Aansh Shah, Jerome Ramos, Jun Ki Lee, Jacob Beck, Aaron Zhang
Rok vydání: 2019
Předmět:
Zdroj: Social Robotics ISBN: 9783030358877
ICSR
DOI: 10.1007/978-3-030-35888-4_34
Popis: Mutually beneficial behavior in repeated games can be enforced via the threat of punishment, as enshrined in game theory’s well-known “folk theorem.” There is a cost, however, to a player for generating these disincentives. In this work, we seek to minimize this cost by computing a “Stackelberg punishment,” in which the player selects a behavior that sufficiently punishes the other player while maximizing its own score under the assumption that the other player will adopt a best response. This idea generalizes the concept of a Stackelberg equilibrium. Known efficient algorithms for computing a Stackelberg equilibrium can be adapted to efficiently produce a Stackelberg punishment. We demonstrate an application of this idea in an experiment involving a virtual autonomous vehicle and human participants. We find that a self-driving car with a Stackelberg punishment policy discourages human drivers from bullying in a driving scenario requiring social negotiation.
Databáze: OpenAIRE