Overview of the CLEF eHealth Evaluation Lab 2020

Autor: Zhengyang Liu, Lorraine Goeuriot, Antonio Miranda-Escalada, Liadh Kelly, Marco Viviani, Martin Krallinger, Hanna Suominen, Gabriela Gonzalez Saez, Chenchen Xu, Gabriella Pasi
Přispěvatelé: Laboratoire d'Informatique de Grenoble (LIG), Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes (UGA)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP ), Université Grenoble Alpes (UGA), Australian National University (ANU), Data61 [Canberra] (CSIRO), Australian National University (ANU)-Commonwealth Scientific and Industrial Research Organisation [Canberra] (CSIRO), University of Turku, Computer Science Department [Maynooth], National University of Ireland Maynooth (Maynooth University), Barcelona Supercomputing Center - Centro Nacional de Supercomputacion (BSC - CNS), Università degli Studi di Milano-Bicocca [Milano] (UNIMIB), Goeuriot, L, Suominen, H, Kelly, L, Miranda-Escalada, A, Krallinger, M, Liu, Z, Pasi, G, Gonzalez Saez, G, Viviani, M, Xu, C
Jazyk: angličtina
Rok vydání: 2020
Předmět:
Zdroj: International Conference of the Cross-Language Evaluation Forum for European Languages
International Conference of the Cross-Language Evaluation Forum for European Languages, pp.255-271, 2020, ⟨10.1007/978-3-030-58219-7_19⟩
Lecture Notes in Computer Science ISBN: 9783030582180
CLEF
DOI: 10.1007/978-3-030-58219-7_19⟩
Popis: In this paper, we provide an overview of the eight annual edition of the Conference and Labs of the Evaluation Forum (CLEF) eHealth evaluation lab. The Conference and Labs of the Evaluation Forum (CLEF) eHealth 2020 continues our development of evaluation tasks and resources since 2012 to address laypeople’s difficulties to retrieve and digest valid and relevant information in their preferred language to make health-centred decisions. This year’s lab advertised two tasks. Task 1 on Information Extraction (IE) was new and focused on automatic clinical coding of diagnosis and procedure the tenth revision of the International Statistical Classification of Diseases and Related Health Problems (ICD10) codes as well as finding the corresponding evidence text snippets for clinical case documents in Spanish. Task 2 on Information Retrieval (IR) was a novel extension of the most popular and established task in the Conference and Labs of the Evaluation Forum (CLEF) eHealth on Consumer Health Search (CHS). In total 55 submissions were made to these tasks. Herein, we describe the resources created for the two tasks and evaluation methodology adopted. We also summarize lab submissions and results. As in previous years, the organizers have made data and tools associated with the lab tasks available for future research anddevelopment. The ongoing substantial community interest in the tasks and their resources has led to the Conference and Labs of the Evaluation Forum (CLEF) eHealth maturing as a primary venue for all interdisciplinary actors of the ecosystem for producing, processing, and consuming electronic healthinformation.
Databáze: OpenAIRE