Hierarchical Evaluation Framework: Best Practices for Human Evaluation

Autor: Bojic, Iva, Chen, Jessica, Chang, Si Yuan, Ong, Qi Chwen, Joty, Shafiq, Car, Josip

Human evaluation plays a crucial role in Natural Language Processing (NLP) as it assesses the quality and relevance of developed systems, thereby facilitating their enhancement. However, the absence of widely accepted human evaluation metrics in NLP

Externí odkaz: http://arxiv.org/abs/2310.01917

A Data-centric Framework for Improving Domain-specific Machine Reading Comprehension Datasets

Autor: Bojic, Iva, Halim, Josef, Suharman, Verena, Tar, Sreeja, Ong, Qi Chwen, Phung, Duy, Ravaut, Mathieu, Joty, Shafiq, Car, Josip

Publikováno v: 2023.In The Fourth Workshop on Insights from Negative Results in NLP, pages 19-32, Dubrovnik, Croatia. Association for Computational Linguistics

Low-quality data can cause downstream problems in high-stakes applications. Data-centric approach emphasizes on improving dataset quality to enhance model performance. High-quality datasets are needed for general-purpose Large Language Models (LLMs)

Externí odkaz: http://arxiv.org/abs/2304.00483

Tento výsledek nelze pro nepřihlášené uživatele zobrazit.
K zobrazení výsledku je třeba se přihlásit.

Understanding COVID-19 Impacts on the Health Workforce: AI-Assisted Open-Source Media Content Analysis.

Autor: Pienkowska A; Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore., Ravaut M; College of Computing and Data Science, Nanyang Technological University, Singapore, Singapore., Mammadova M; Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore., Ang CS; Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore., Wang H; Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore., Ong QC; Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore., Bojic I; Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore., Qin VM; Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore., Sumsuzzman DM; Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore., Ajuebor O; Human Resources for Health Policies and Standards Unit, Health Workforce Department, World Health Organization, Geneva, Switzerland., Boniol M; Data, Evidence and Knowledge Unit, Health Workforce Department, World Health Organization, Geneva, Switzerland., Bustamante JP; Health Labour Market Unit, Health Workforce Department, World Health Organization, Geneva, Switzerland., Campbell J; Director's Office, Health Workforce Department, World Health Organization, Geneva, Switzerland., Cometto G; Human Resources for Health Policies and Standards Unit, Health Workforce Department, World Health Organization, Geneva, Switzerland., Fitzpatrick S; Human Resources for Health Policies and Standards Unit, Health Workforce Department, World Health Organization, Geneva, Switzerland., Kane C; Human Resources for Health Policies and Standards Unit, Health Workforce Department, World Health Organization, Geneva, Switzerland., Joty S; College of Computing and Data Science, Nanyang Technological University, Singapore, Singapore., Car J; Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore.

Publikováno v: JMIR formative research [JMIR Form Res] 2024 Jun 13; Vol. 8, pp. e53574. Date of Electronic Publication: 2024 Jun 13.