Scalarized and pareto knowledge gradient for multi-objective multi-armed bandits
| Autor: | Yahyaa, S., Drugan, M.M., Manderick, B., Nguyen, N.T., Kowalczyk, R., Duval, B., van den Herik, J., Loiseau, St., Filipe, J. |
|---|---|
| Přispěvatelé: | Informatics and Applied Informatics, Computational Modelling, Faculty of Sciences and Bioengineering Sciences, Mathematics and Computer Science |
| Jazyk: | angličtina |
| Rok vydání: | 2015 |
| Předmět: | |
| Zdroj: | Transactions on Computational Collective Intelligence XX ISBN: 9783319275420 Transactions on Computational Collective Intelligence XX, 99-116 STARTPAGE=99;ENDPAGE=116;TITLE=Transactions on Computational Collective Intelligence XX |
| DOI: | 10.1007/978-3-319-27543-7_5 |
| Popis: | A multi-objective multi-armed bandit (MOMAB) problem is a sequential decision process with stochastic reward vectors. We extend knowledge gradient (KG) policy to the MOMAB problem, and we propose Pareto-KG and scalarized-KG algorithms. The Pareto-KG trades off between exploration and exploitation by combining KG policy with Pareto dominance relations. The scalarized-KG makes use of a linear or non-linear scalarization function to convert the MOMAB problem into a single-objective multi-armed bandit problem and uses KG policy to trade off between exploration and exploitation. To measure the performance of the proposed algorithms, we introduce three regret measures. We compare empirically the performance of the KG policy with UCB1 policy on a test suite of MOMAB problems with normal distributions. The Pareto-KG and scalarized-KG are the algorithms with the best empirical performance. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|