A prediction-based method to estimate student learning outcome: Impact of response rate and gender differences on evaluation results
| Autor: | Binia-Laureen Grebener, Janina Barth, Sven Anders, Tobias Raupach, Tim Beißbarth |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
Male
Self-assessment Self-Assessment Students Medical 020205 medical informatics education Applied psychology 02 engineering and technology Outcome (game theory) Education 03 medical and health sciences Sex Factors 0302 clinical medicine ComputingMilieux_COMPUTERSANDEDUCATION 0202 electrical engineering electronic engineering information engineering Humans 030212 general & internal medicine Student learning Reliability (statistics) Response rate (survey) 4. Education Reproducibility of Results General Medicine Female Curriculum Educational Measurement Psychology Education Medical Undergraduate |
| Zdroj: | Medical Teacher. 43:524-530 |
| ISSN: | 1466-187X 0142-159X |
| Popis: | Low response rates threaten the reliability and validity of student evaluations of teaching. Previous research has shown that asking students to predict how satisfied their fellow students were with a course produces reliable results at lower response rates. The aim of this study was to investigate whether this prediction-based method can also be used to evaluate student learning outcome.Before and after a cardiorespiratory module, 128 fourth-year medical students provided self-assessments and predictions of performance on 27 specific learning objectives and took formative tests on the respective contents. Pre-post performance gain was compared across all three modalities.Formative exam results indicated a performance gain of 63.0%. Self-assessed and prediction-based performance gains were identical (67.8%) but both slightly overestimated actual performance gain. Irrespective of the method used, a response rate of 20% was sufficient to produce reliable results. Compared to male students, females greatly overestimated their peers' performance which led to inflated performance gain values.Student self-assessments and predictions are equally valid sources of learning outcome measures, and low response rates are sufficient to produce stable results. When using a prediction-based approach, a tendency to overestimate learning outcome in female students needs to be taken into account. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
| Nepřihlášeným uživatelům se plný text nezobrazuje | K zobrazení výsledku je třeba se přihlásit. |