Extracting Wisdom from Experts and Small Crowds: Strategies for Improving Informant-based Measures of Political Concepts
| Autor: | Cherie D. Maestas, Walter J. Stone, Matthew K. Buttice |
|---|---|
| Rok vydání: | 2014 |
| Předmět: |
Knowledge management
Sociology and Political Science business.industry 05 social sciences Score Validity 0506 political science Weighting Politics Crowds 0502 economics and business Political Science and International Relations 050602 political science & public administration 050211 marketing business Psychology Selection (genetic algorithm) |
| Zdroj: | Political Analysis. 22:354-373 |
| ISSN: | 1476-4989 1047-1987 |
| DOI: | 10.1093/pan/mpt050 |
| Popis: | Social scientists have increasingly turned to expert judgments to generate data for difficult-to-measure concepts, but getting access to and response from highly expert informants can be costly and challenging. We examine how informant selection and post-survey response aggregation influence the validity and reliability of measures built from informant observations. We draw upon three surveys with parallel survey questions of candidate characteristics to examine the trade-off between expanding the size of the local informant pool and the pool's level of expertise. We find that a “wisdom-of-crowds” effect trumps the benefits associated with the expertise of individual informants when the size of the rater pool is modestly increased. We demonstrate that the benefits of expertise are best realized by prescreening potential informants for expertise rather than post-survey weighting by expertise. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|