Does web mode increase satisficing?

Autor: Sanne Lund Clement, Jonsdottir, Gudbjorg A., Majbritt Kappelgaard Severin-Nielsen, Ditte Shamshiri-Petersen
Jazyk: angličtina
Rok vydání: 2020
Zdroj: Clement, S L, A. Jonsdottir, G, Severin, M C & Shamshiri-Petersen, D 2020, ' Does web mode increase satisficing? ', General Online Research 2020, Berlin, Germany, 11/03/2020-13/03/2020 . < https://www.gor.de/gor20/index.php?page=browseSessions&presentations=show&search=Does+web+mode+increase+satisficing >
Aalborg University
Popis: Relevance & Research Question: The advantages and disadvantages of web-based surveys have been heavily discussed from their beginning. Often, it is emphasized that web surveys are less time consuming and cheaper to conduct than other data collection modes. In earlier literature on mode effects, however, it was commonly held that this come at the expense of data quality because the web negatively affects respondents’ cognitive effort to answer survey questions carefully. Even though later studies acknowledge that web mode does not per se produce lesser-quality data, some reluctance still exist. The current study addresses the question of whether an actual “web mode effect” exists when self-selection and interviewer effects are eliminated. Methods & Data: The study utilized data from four national survey experiments in Denmark, Norway, Iceland, and Finland (total n=6,219). All experiments were conducted in 2014/2015 as a part of the ISSP 2014 module on “Citizenship”. Respondents were assigned randomly to one of two mode groups: One group answered the survey on web (‘web group’) whereas the other group answered on paper (‘paper group’). The experimental design enabled the elimination of self-selection effects, and by comparing web mode with another self-administered mode, possible interviewer effects were eliminated as well. To test mode main effects on data quality, multiple linear regression analyses were conducted. In these, two measures of satisficing behaviors (low to high) were used to examine differences in data quality. Results: Comparisons of web and paper modes suggested that such a “web mode effect” does not exist, since respondents in the web group were not more prone to satisfice than respondents in the paper group. In other words, no evidence was found that web mode produces lesser-quality data than other self-administered modes of data collection. Added Value: The study contributed to state-of-the-art by providing more solid empirical knowledge of whether an actual “web mode effect” exists when self-selection and interviewer effects are eliminated. Whereas previous studies used non-probability sampling procedures, small-n samples, self-selection of modes, or samples from population subgroups, this study employed an experimental design and utilized data from large-n population samples. Relevance & Research Question: The advantages and disadvantages of web-based surveys have been heavily discussed from their beginning. Often, it is emphasized that web surveys are less time consuming and cheaper to conduct than other data collection modes. In earlier literature on mode effects, however, it was commonly held that this come at the expense of data quality because the web negatively affects respondents’ cognitive effort to answer survey questions carefully. Even though later studies acknowledge that web mode does not per se produce lesser-quality data, some reluctance still exist. The current study addresses the question of whether an actual “web mode effect” exists when self-selection and interviewer effects are eliminated. Methods & Data: The study utilized data from four national survey experiments in Denmark, Norway, Iceland, and Finland (total n=6,219). All experiments were conducted in 2014/2015 as a part of the ISSP 2014 module on “Citizenship”. Respondents were assigned randomly to one of two mode groups: One group answered the survey on web (‘web group’) whereas the other group answered on paper (‘paper group’). The experimental design enabled the elimination of self-selection effects, and by comparing web mode with another self-administered mode, possible interviewer effects were eliminated as well. To test mode main effects on data quality, multiple linear regression analyses were conducted. In these, two measures of satisficing behaviors (low to high) were used to examine differences in data quality. Results: Comparisons of web and paper modes suggested that such a “web mode effect” does not exist, since respondents in the web group were not more prone to satisfice than respondents in the paper group. In other words, no evidence was found that web mode produces lesser-quality data than other self-administered modes of data collection. Added Value: The study contributed to state-of-the-art by providing more solid empirical knowledge of whether an actual “web mode effect” exists when self-selection and interviewer effects are eliminated. Whereas previous studies used non-probability sampling procedures, small-n samples, self-selection of modes, or samples from population subgroups, this study employed an experimental design and utilized data from large-n population samples.
Databáze: OpenAIRE
Externí odkaz: