Overview of the CLEF eHealth Evaluation Lab 2021

Autor: Rishabh Upadhyay, Nicola Brew-Sam, Jorge Vivaldi, Marco Viviani, Viviana Cotik, Hanna Suominen, Elias Bassani, Roland Roller, Chenchen Xu, Gabriela Nicole González-Sáez, Darío Filippo, Philippe Mulhem, Liadh Kelly, Gabriella Pasi, Lorraine Goeuriot, Franco M. Luque, Laura Alonso Alemany, Sandaru Seneviratne
Přispěvatelé: Candan, KS, Ionescu, B, Goeuriot, L, Larsen, B, Müller, H, Joly, A, Maistro, M, Piroi, F, Faggioli, G, Ferro, N, Suominen, H, Kelly, L, Alemany, L, Bassani, E, Brew-Sam, N, Cotik, V, Filippo, D, González-Sáez, G, Luque, F, Mulhem, P, Pasi, G, Roller, R, Seneviratne, S, Upadhyay, R, Vivaldi, J, Viviani, M, Xu, C, Australian National University (ANU), Commonwealth Scientific and Industrial Research Organisation [Canberra] (CSIRO), University of Turku, Modélisation et Recherche d’Information Multimédia [Grenoble] (MRIM ), Laboratoire d'Informatique de Grenoble (LIG), Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes (UGA)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP ), Université Grenoble Alpes (UGA)-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes (UGA)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP ), Université Grenoble Alpes (UGA), Computer Science Department [Maynooth], National University of Ireland Maynooth (Maynooth University), Universidad Nacional de Córdoba [Argentina], Università degli Studi di Milano-Bicocca [Milano] (UNIMIB), Consorzio per il Trasferimento Tecnologico (C2T), Departamento de Computación [Buenos Aires], Facultad de Ciencias Exactas y Naturales [Buenos Aires] (FCEyN), Universidad de Buenos Aires [Buenos Aires] (UBA)-Universidad de Buenos Aires [Buenos Aires] (UBA), CONICET / IICE-UBA, Instituto de Investigación en Ciencias de la Computación [Buenos Aires] (ICC), Consejo Nacional de Investigaciones Científicas y Técnicas [Buenos Aires] (CONICET)-Facultad de Ciencias Exactas y Naturales [Buenos Aires] (FCEyN), Modélisation et Recherche d’Information Multimédia [Grenoble] (MRIM), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut National Polytechnique de Grenoble (INPG)-Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut National Polytechnique de Grenoble (INPG)-Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF), Deutsches Forschungszentrum für Künstliche Intelligenz GmbH = German Research Center for Artificial Intelligence (DFKI), Universitat Pompeu Fabra [Barcelona] (UPF), ANR-19-CE23-0029,Kodicare,Variations de l'environnement d'évaluation : caractérisation du delta et impact sur l'évolution continue des systèmes de recherche d'information(2019)
Jazyk: angličtina
Rok vydání: 2021
Předmět:
Zdroj: Experimental IR Meets Multilinguality, Multimodality, and Interaction
Experimental IR Meets Multilinguality, Multimodality, and Interaction, 12880, Springer International Publishing, pp.308-323, 2021, Lecture Notes in Computer Science, ⟨10.1007/978-3-030-85251-1_21⟩
Lecture Notes in Computer Science ISBN: 9783030852504
CLEF
Popis: In this paper, we provide an overview of the ninth annual edition of the CLEF eHealth evaluation lab. CLEF eHealth 2021 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins, health care professionals, and health scientists in understanding, accessing, and authoring electronic health information in a multilingual setting. The 2021 lab offered two tasks: Task 1 on multilingual Information Extraction (IE), this year extending to a corpus of Spanish radiology reports; and Task 2 on Consumer Health Search (CHS) that builds on the previous year’s Information Retrieval (IR) tasks. In total, 11 teams took part in these tasks (7 in Task 1 on IE and 4 in Task 2 on IR). Herein, we describe the resources created for these tasks and the evaluation methodology adopted, and we provide a brief summary of the participants of this year’s challenges as well as the results obtained. As in previous years, the organizers have made data, tools, and more specific overview papers associated with the lab tasks available for future research and development.
Databáze: OpenAIRE