Learning the travelling salesperson problem requires rethinking generalization
| Autor: | Chaitanya K. Joshi, Quentin Cappart, Louis-Martin Rousseau, Thomas Laurent |
|---|---|
| Přispěvatelé: | Joshi, Chaitanya K [0000-0003-4722-1815], Apollo - University of Cambridge Repository |
| Rok vydání: | 2022 |
| Předmět: |
FOS: Computer and information sciences
Computer Science - Machine Learning Computational Theory and Mathematics 46 Information and Computing Sciences Artificial Intelligence Statistics - Machine Learning 4611 Machine Learning Discrete Mathematics and Combinatorics Machine Learning (stat.ML) Software Machine Learning (cs.LG) |
| DOI: | 10.17863/cam.85173 |
| Popis: | End-to-end training of neural network solvers for graph combinatorial optimization problems such as the Travelling Salesperson Problem (TSP) have seen a surge of interest recently, but remain intractable and inefficient beyond graphs with few hundreds of nodes. While state-of-the-art learning-driven approaches for TSP perform closely to classical solvers when trained on trivially small sizes, they are unable to generalize the learnt policy to larger instances at practical scales. This work presents an end-to-end neural combinatorial optimization pipeline that unifies several recent papers in order to identify the inductive biases, model architectures and learning algorithms that promote generalization to instances larger than those seen in training. Our controlled experiments provide the first principled investigation into such zero-shot generalization, revealing that extrapolating beyond training data requires rethinking the neural combinatorial optimization pipeline, from network layers and learning paradigms to evaluation protocols. Additionally, we analyze recent advances in deep learning for routing problems through the lens of our pipeline and provide new directions to stimulate future research. Accepted to the 27th International Conference on Principles and Practice of Constraint Programming (CP 2021) and Constraints (2022). Code and data available at https://github.com/chaitjo/learning-tsp |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|