A Meta-Analytical Multilevel Reliability Generalization of Situational Judgment Tests (SJTs)
Autor: | Nadine Kasten, Philipp Alexander Freund |
---|---|
Rok vydání: | 2016 |
Předmět: |
Situational judgement test
Generalization 05 social sciences Multilevel model Applied psychology Personnel selection 050401 social sciences methods Reliability generalization Affect (psychology) Popularity Cronbach's alpha SJT Situational Judgment Test 0504 sociology 0502 economics and business Statistics Psychology 050203 business & management Applied Psychology Reliability (statistics) |
Zdroj: | Kasten, N & Freund, P A 2016, ' A Meta-Analytical Multilevel Reliability Generalization of Situational Judgment Tests (SJTs) ' European Journal of Psychological Assessment, vol 32, no. 3, pp. 230-240 . DOI: 10.1027/1015-5759/a000250 Kasten, N & Freund, P A 2016, ' A Meta-Analytical Multilevel Reliability Generalization of Situational Judgment Tests (SJTs) ', European Journal of Psychological Assessment, vol. 32, no. 3, pp. 230-240 . https://doi.org/10.1027/1015-5759/a000250 |
ISSN: | 2151-2426 1015-5759 |
DOI: | 10.1027/1015-5759/a000250 |
Popis: | Abstract. During the past 20 years, Situational Judgment Tests (SJTs) have developed into a viable tool in personnel selection. Despite their growing popularity, research examining the extent of measurement error is widely lacking. Using reliability generalization, the aim of this article was twofold: (1) establish an estimate for an average coefficient alpha of SJT scores across studies and (2) examine the influence of essential SJT features and selected study variables on score reliability. To handle potential dependent observations a three-level hierarchical linear model was used. The results indicate that the reliability of SJT scores is typically rather low and below recommended levels for high-stakes applications. Additionally, both SJT and study characteristics affect score reliability. Implications for practitioners and researchers are provided to guide an appropriate use of SJTs and to initiate future research. |
Databáze: | OpenAIRE |
Externí odkaz: |