Arbitrariness in the peer review process

Autor:	Aliaksandr Birukou, Elise S. Brezis
Rok vydání:	2020
Předmět:	Taste (sociology) media_common.quotation_subject General Social Sciences Library and Information Sciences Arbitrariness Data science Homophily Computer Science Applications Ranking Perception Element (criminal law) Psychology media_common
Zdroj:	Scientometrics. 123:393-411
ISSN:	1588-2861 0138-9130
DOI:	10.1007/s11192-020-03348-1
Popis:	The purpose of this paper is to analyze the causes and effects of arbitrariness in the peer review process. This paper focuses on two main reasons for the arbitrariness in peer review. The first is that referees are not homogenous and display homophily in their taste and perception of innovative ideas. The second element is that reviewers are different in the time they allocate for peer review. Our model replicates the NIPS experiment of 2014, showing that the ratings of peer review are not robust, and that altering reviewers leads to a dramatic impact on the ranking of the papers. This paper also shows that innovative works are not highly ranked in the existing peer review process, and in consequence are often rejected.
Databáze:	OpenAIRE
Externí odkaz:	https://explore.openaire.eu/search/publication?articleId=doi_________::0a8cbc1ef31624efbf4032661fd994e2 https://doi.org/10.1007/s11192-020-03348-1 Zobrazit plný text záznamu Full text from SpringerLink