Attention Check Items and Instructions in Online Surveys with Incentivized and Non-Incentivized Samples: Boon or Bane for Data Quality?

Autor: Hawal Shamon, Carl Clemens Berning
Jazyk: angličtina
Rok vydání: 2020
Předmět:
Zdroj: Survey Research Methods, Vol 14, Iss 1 (2020)
Druh dokumentu: article
ISSN: 1864-3361
DOI: 10.18148/srm/2020.v14i1.7374
Popis: In this paper, we examine rates of careless responding and reactions towards detection methods (i.e., attention check item and instruction) in an experimental setting based on two different samples. First, we use a quota sample (with monetary incentive), a central data source for internet-based surveys in sociological and political research. Second, we include a voluntary opt-in panel (without monetary incentive) well suited to conduct survey experiments (e.g., factorial surveys). Respondents’ reactions towards the detection items are analyzed by objective, non-reactive indicators (i.e., break-off, item nonresponse, and measurement quality), and two self-report scales. Our reaction analyses reveal that the detection methods that we applied are not only well suited to identify careless respondents but also exert a motivational rather than demotivating influence on respondents’ answer behavior and, hence, contribute to data quality.
Databáze: Directory of Open Access Journals