Learning to Drive via Asymmetric Self-Play

Autor:	Zhang, Chris, Biswas, Sourav, Wong, Kelvin, Fallah, Kion, Zhang, Lunjun, Chen, Dian, Casas, Sergio, Urtasun, Raquel
Rok vydání:	2024
Předmět:	Computer Science - Robotics Computer Science - Computer Vision and Pattern Recognition Computer Science - Machine Learning
Druh dokumentu:	Working Paper
Popis:	Large-scale data is crucial for learning realistic and capable driving policies. However, it can be impractical to rely on scaling datasets with real data alone. The majority of driving data is uninteresting, and deliberately collecting new long-tail scenarios is expensive and unsafe. We propose asymmetric self-play to scale beyond real data with additional challenging, solvable, and realistic synthetic scenarios. Our approach pairs a teacher that learns to generate scenarios it can solve but the student cannot, with a student that learns to solve them. When applied to traffic simulation, we learn realistic policies with significantly fewer collisions in both nominal and long-tail scenarios. Our policies further zero-shot transfer to generate training data for end-to-end autonomy, significantly outperforming state-of-the-art adversarial approaches, or using real data alone. For more information, visit https://waabi.ai/selfplay . Comment: ECCV 2024
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/2409.18218 Zobrazit plný text záznamu View this record from Arxiv