Overview of the CLEF dynamic search evaluation lab 2018
| Autor: | Kanoulas, E., Azzopardi, L., Yang, G.H., Bellot, P., Trabelsi, C., Mothe, J., Murtagh, F., Nie, J.Y., Soulier, L., SanJuan, E., Cappellato, L., Ferro, N. |
|---|---|
| Přispěvatelé: | Information and Language Processing Syst (IVI, FNWI), Operations Management (ABS, FEB) |
| Jazyk: | angličtina |
| Rok vydání: | 2018 |
| Předmět: |
Information retrieval
Computer science Contextual advertising 02 engineering and technology Clef Session (web analytics) Personalization Ranking (information retrieval) Search algorithm 020204 information systems 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Dialog box Metasearch engine |
| Zdroj: | Experimental IR Meets Multilinguality, Multimodality, and Interaction: 9th International Conference of the CLEF Association, CLEF 2018, Avignon, France, September 10-14, 2018 : Proceedings, 362-371 STARTPAGE=362;ENDPAGE=371;TITLE=Experimental IR Meets Multilinguality, Multimodality, and Interaction Lecture Notes in Computer Science ISBN: 9783319989310 CLEF |
| DOI: | 10.1007/978-3-319-98932-7_31 |
| Popis: | In this paper we provide an overview of the CLEF 2018 Dynamic Search Lab. The lab ran for the first time in 2017 as a workshop. The outcomes of the workshop were used to define the tasks of this year’s evaluation lab. The lab strives to answer one key question: how can we evaluate, and consequently build, dynamic search algorithms? Unlike static search algorithms, which consider user request’s independently, and consequently do not adapt their ranking with respect to the user’s sequence of interactions and the user’s end goal, dynamic search algorithms try to infer the user’s intentions based on their interactions and adapt their ranking accordingly. Session personalization, contextual search, conversational search, dialog systems are some examples of dynamic search. Herein, we describe the overall objectives of the CLEF 2018 Dynamic Search Lab, the resources created, and the evaluation methodology designed. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|