Enhancing Prediction Models with Reinforcement Learning

Autor: Radziszewski, Karol, Ociepka, Piotr
Rok vydání: 2024
Předmět:
Druh dokumentu: Working Paper
Popis: We present a large-scale news recommendation system implemented at Ringier Axel Springer Polska, focusing on enhancing prediction models with reinforcement learning techniques. The system, named Aureus, integrates a variety of algorithms, including multi-armed bandit methods and deep learning models based on large language models (LLMs). We detail the architecture and implementation of Aureus, emphasizing the significant improvements in online metrics achieved by combining ranking prediction models with reinforcement learning. The paper further explores the impact of different models mixing on key business performance indicators. Our approach effectively balances the need for personalized recommendations with the ability to adapt to rapidly changing news content, addressing common challenges such as the cold start problem and content freshness. The results of online evaluation demonstrate the effectiveness of the proposed system in a real-world production environment.
Comment: INRA 24: 12th International Workshop on News Recommendation and Analytics in Conjunction with ACM RecSys 2024
Databáze: arXiv