Addressing Threats to Validity in Supervised Machine Learning: A Framework and Best Practices for Education Researchers

Autor: Kylie Anglin
Jazyk: angličtina
Rok vydání: 2024
Předmět:
Zdroj: AERA Open, Vol 10 (2024)
Druh dokumentu: article
ISSN: 2332-8584
23328584
DOI: 10.1177/23328584241303495
Popis: Given the rapid adoption of machine learning methods by education researchers, and the growing acknowledgment of their inherent risks, there is an urgent need for tailored methodological guidance on how to improve and evaluate the validity of inferences drawn from these methods. Drawing on an integrative literature review and extending a well-known framework for theorizing validity in the social sciences, this article provides both an overview of threats to validity in supervised machine learning and plausible approaches for addressing such threats. It collates a list of current best practices, brings supervised learning challenges into a unified conceptual framework, and offers a straightforward reference guide on crucial validity considerations. Finally, it proposes a novel research protocol for researchers to use during project planning and for reviewers and scholars to use when evaluating the validity of supervised machine learning applications.
Databáze: Directory of Open Access Journals