A novel method for estimating the common signals for consensus across multiple ranked lists
| Autor: | Vendula Svendova, Michael G. Schimek |
|---|---|
| Rok vydání: | 2017 |
| Předmět: |
0301 basic medicine
Statistics and Probability Applied Mathematics media_common.quotation_subject Rank (computer programming) Stability (learning theory) Decision quality Inference Indirect Inference computer.software_genre 01 natural sciences 010104 statistics & probability 03 medical and health sciences Computational Mathematics 030104 developmental biology Computational Theory and Mathematics Ranking Quality (business) Relevance (information retrieval) Data mining 0101 mathematics computer Mathematics media_common |
| Zdroj: | Computational Statistics & Data Analysis. 115:122-135 |
| ISSN: | 0167-9473 |
| Popis: | The ranking of objects, such as journals, institutions or biological entities, is broadly used to assess the relative quality or relevance of such objects. A multiple ranking is performed by a number of assessors (humans or machines) and inference about the nature of the observed rankings is desirable for evaluation, business or scientific purposes. The assessors’ decisions are based on some inherent metric scale and depend on judgement and discriminatory ability, data to which we usually do not have access. An indirect inference approach is proposed that allows one to estimate those signal parameters that might be causal for the observed rankings obtained from several assessors, some of which may not necessarily provide the same decision quality. The order of the values represents a consensus ranking across the observed individual rankings. The standard errors of the estimated signal parameters are obtained through a non-parametric bootstrap. Hence, the signal variability can be evaluated object-wise for the purpose of quantifying the stability of the associated rank positions. As a result, such signal estimates can be used in the meta-analysis of conceptually similar evaluation exercises, studies or experiments, and in any data integration task where measurements on the metric scale are either unavailable, or not directly comparable. The suggested approach is validated on simulated rank data as well as on experimental rank data from current molecular medicine. The proposed algorithms were implemented and all calculations performed in the R environment. The source code is provided. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect