Overview of the CLEF eHealth Evaluation Lab 2020
Autor: | Zhengyang Liu, Lorraine Goeuriot, Antonio Miranda-Escalada, Liadh Kelly, Marco Viviani, Martin Krallinger, Hanna Suominen, Gabriela Gonzalez Saez, Chenchen Xu, Gabriella Pasi |
---|---|
Přispěvatelé: | Laboratoire d'Informatique de Grenoble (LIG), Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes (UGA)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP ), Université Grenoble Alpes (UGA), Australian National University (ANU), Data61 [Canberra] (CSIRO), Australian National University (ANU)-Commonwealth Scientific and Industrial Research Organisation [Canberra] (CSIRO), University of Turku, Computer Science Department [Maynooth], National University of Ireland Maynooth (Maynooth University), Barcelona Supercomputing Center - Centro Nacional de Supercomputacion (BSC - CNS), Università degli Studi di Milano-Bicocca [Milano] (UNIMIB), Goeuriot, L, Suominen, H, Kelly, L, Miranda-Escalada, A, Krallinger, M, Liu, Z, Pasi, G, Gonzalez Saez, G, Viviani, M, Xu, C |
Jazyk: | angličtina |
Rok vydání: | 2020 |
Předmět: |
Information extraction
Computer science 0206 medical engineering 02 engineering and technology Speech recognition computer.software_genre Health informatics World Wide Web Health record 03 medical and health sciences 0302 clinical medicine eHealth International Statistical Classification of Diseases and Related Health Problems Test-set generation 030212 general & internal medicine Medical informatic Evaluation ComputingMilieux_MISCELLANEOUS business.industry Consumer health Information storage and retrieval Clef 3. Good health [INFO.INFO-IR]Computer Science [cs]/Information Retrieval [cs.IR] Health information business Relevant information computer 020602 bioinformatics |
Zdroj: | International Conference of the Cross-Language Evaluation Forum for European Languages International Conference of the Cross-Language Evaluation Forum for European Languages, pp.255-271, 2020, ⟨10.1007/978-3-030-58219-7_19⟩ Lecture Notes in Computer Science ISBN: 9783030582180 CLEF |
DOI: | 10.1007/978-3-030-58219-7_19⟩ |
Popis: | In this paper, we provide an overview of the eight annual edition of the Conference and Labs of the Evaluation Forum (CLEF) eHealth evaluation lab. The Conference and Labs of the Evaluation Forum (CLEF) eHealth 2020 continues our development of evaluation tasks and resources since 2012 to address laypeople’s difficulties to retrieve and digest valid and relevant information in their preferred language to make health-centred decisions. This year’s lab advertised two tasks. Task 1 on Information Extraction (IE) was new and focused on automatic clinical coding of diagnosis and procedure the tenth revision of the International Statistical Classification of Diseases and Related Health Problems (ICD10) codes as well as finding the corresponding evidence text snippets for clinical case documents in Spanish. Task 2 on Information Retrieval (IR) was a novel extension of the most popular and established task in the Conference and Labs of the Evaluation Forum (CLEF) eHealth on Consumer Health Search (CHS). In total 55 submissions were made to these tasks. Herein, we describe the resources created for the two tasks and evaluation methodology adopted. We also summarize lab submissions and results. As in previous years, the organizers have made data and tools associated with the lab tasks available for future research anddevelopment. The ongoing substantial community interest in the tasks and their resources has led to the Conference and Labs of the Evaluation Forum (CLEF) eHealth maturing as a primary venue for all interdisciplinary actors of the ecosystem for producing, processing, and consuming electronic healthinformation. |
Databáze: | OpenAIRE |
Externí odkaz: |