Passage Retrieval of Polish Texts Using OKAPI BM25 and an Ensemble of Cross Encoders

Autor: Pokrywka, Jakub
Rok vydání: 2024
Předmět:
Zdroj: Proceedings of the 18th Conference on Computer Science and Intelligence Systems, M. Ganzha, L. Maciaszek, M. Paprzycki, D. \'Sl\k{e}zak (eds). ACSIS, Vol. 35, pages 1265-1269 (2023)
Druh dokumentu: Working Paper
DOI: 10.15439/2023F9253
Popis: Passage Retrieval has traditionally relied on lexical methods like TF-IDF and BM25. Recently, some neural network models have surpassed these methods in performance. However, these models face challenges, such as the need for large annotated datasets and adapting to new domains. This paper presents a winning solution to the Poleval 2023 Task 3: Passage Retrieval challenge, which involves retrieving passages of Polish texts in three domains: trivia, legal, and customer support. However, only the trivia domain was used for training and development data. The method used the OKAPI BM25 algorithm to retrieve documents and an ensemble of publicly available multilingual Cross Encoders for Reranking. Fine-tuning the reranker models slightly improved performance but only in the training domain, while it worsened in other domains.
Databáze: arXiv