A new experiment on the use of images to answer web survey questions.

Autor: Bosch OJ; London School of Economics and Political Science London UK.; Research and Expertise Centre for Survey Methodology (RECSM) Universitat Pompeu Fabra Barcelona Spain., Revilla M; Research and Expertise Centre for Survey Methodology (RECSM) Universitat Pompeu Fabra Barcelona Spain., Qureshi DD; Cheil Germany Frankfurt Germany., Höhne JK; Research and Expertise Centre for Survey Methodology (RECSM) Universitat Pompeu Fabra Barcelona Spain.; Collaborative Research Center SFB 884 'Political Economy of Reforms' University of Mannheim Mannheim Germany.
Jazyk: angličtina
Zdroj: Journal of the Royal Statistical Society. Series A, (Statistics in Society) [J R Stat Soc Ser A Stat Soc] 2022 Jul; Vol. 185 (3), pp. 955-980. Date of Electronic Publication: 2022 May 20.
DOI: 10.1111/rssa.12856
Abstrakt: Images might provide richer and more objective information than text answers to open-ended survey questions. Little is known, nonetheless, about the consequences for data quality of asking participants to answer open-ended questions with images. Therefore, this paper addresses three research questions: (1) What is the effect of answering web survey questions with images instead of text on breakoff, noncompliance with the task, completion time and question evaluation? (2) What is the effect of including a motivational message on these four aspects? (3) Does the impact of asking to answer with images instead of text vary across device types? To answer these questions, we implemented a 2 × 3 between-subject web survey experiment ( N  = 3043) in Germany. Half of the sample was required to answer using PCs and the other half with smartphones. Within each device group, respondents were randomly assigned to (1) a control group answering open-ended questions with text; (2) a treatment group answering open-ended questions with images; and (3) another treatment group answering open-ended questions with images but prompted with a motivational message. Results show that asking participants to answer with images significantly increases participants' likelihood of noncompliance as well as their completion times, while worsening their overall survey experience. Including motivational messages, moreover, moderately reduces the likelihood of noncompliance. Finally, the likelihood of noncompliance is similar across devices.
(© 2022 The Authors. Journal of the Royal Statistical Society: Series A (Statistics in Society) published by John Wiley & Sons Ltd on behalf of Royal Statistical Society.)
Databáze: MEDLINE
Externí odkaz:
Nepřihlášeným uživatelům se plný text nezobrazuje