Constructed response formats and their effects on minority-majority differences and validity
| Autor: | Janneke K. Oostrom, Jeffrey A. Dahlke, Paul R. Sackett, Britt De Soete, Filip Lievens |
|---|---|
| Přispěvatelé: | Management and Organisation, Amsterdam Business Research Institute |
| Jazyk: | angličtina |
| Rok vydání: | 2019 |
| Předmět: |
Adult
Male Psychometrics education Emigrants and Immigrants Test validity PsycINFO Neuropsychological Tests Judgment Immigrants 0502 economics and business Selection (linguistics) Humans Minority Groups Applied Psychology Minorities Situational judgement test Modality (human–computer interaction) Situational judgment tests 05 social sciences Reproducibility of Results Middle Aged Response format Subgroup differences Test (assessment) Job performance Female Psychology 050203 business & management Cognitive load Cognitive psychology |
| Zdroj: | Lievens, F, Sackett, P R, Dahlke, J A, Oostrom, J K & Soete, B D 2019, ' Constructed response formats and their effects on minority-majority differences and validity ', Journal of Applied Psychology, vol. 104, no. 5, pp. 715-726 . https://doi.org/10.1037/apl0000367 Journal of Applied Psychology, 104(5), 715-726. American Psychological Association |
| ISSN: | 0021-9010 |
| DOI: | 10.1037/apl0000367 |
| Popis: | The inflow of immigrants challenges organizations to consider alternative selection procedures that reduce potential minority (immigrants)-majority (natives) differences, while maintaining valid predictions of performance. To deal with this challenge, this paper proposes response format as a practically and theoretically relevant factor for situational judgment tests (SJTs). We examine a range of response format categories (from traditional multiple-choice formats to more innovative constructed response formats) and conceptually link these response formats to mechanisms underlying minority-majority differences. Two field experiments are conducted with SJTs. Study 1 (274 job seekers) contrasts minority-majority differences in scores on a multiple-choice versus a written constructed response format. Written constructed responses produce much smaller minority-majority differences (d = .28 vs. d = .92). In Study 2 (269 incumbents), scores on a written constructed versus an audiovisual constructed format are compared. The audiovisual format further reduces minority-majority differences (d = .09 vs. d = .41), with validities remaining the same. Results are suggestive of cognitive load as a contributor to the reduction in minority-majority differences, as are rater effects: Scores of raters evaluating transcribed audiovisual responses, which anonymized test takers, produce larger differences. In sum, altering response modality via more realistic response formats (i.e., the audiovisual constructed format) leads to significant reductions in minority-majority differences without impairing criterion-related validity. Implications for selection theory and practice are discussed. (PsycINFO Database Record (c) 2019 APA, all rights reserved). |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|