DOES THE ORDER OF EVALUATION MATTER? THE BIASED REVIEWS IN MANAGING FUNDS.

Autor: Kowalczyk, Katarzyna Kinga
Předmět:
Zdroj: Economic & Social Development: Book of Proceedings; 2019, p68-75, 8p
Abstrakt: Many decision on how to allocate funds are based on the reviews conducted by the experts. Unfortunately expertise doesn't immune from the susceptibility to cognitive biases and counteract for the response style that may influence the final score and thus the decision. In three research tasks we examined the impact of response style and the order of evaluating objects on their score. In task 1, differences between reviewers in terms of the average and variance of grades issued were confirmed in 5 different data set. Reviewers differ significantly in their response style - some are less and others more severe, which means that the random factor associated with the choice of the reviewer significantly affects the assessment of the grant proposal. In task 2 analysis was carried out on a set of assessments of 673 abstracts competing for grants covering the costs of participation in an international conference. Abstracts rated among the first fifteen had a significantly lower average, than those evaluated later. In task 3 two hypotheses were tested in an experimental study showing that the influence of the serial position effect on the assessment depends on the quality of the object: weak objects gain when are evaluated at the beginning of the series, but good lose. An attempt to eliminate this effect by introducing a break in one of the groups (during which the participants of the research performed an additional task of assessing the aesthetics of logotypes) ended in failure. [ABSTRACT FROM AUTHOR]
Databáze: Complementary Index