Web Survey Bibliography
Many studies found that the wording of a survey question can influence the answers that respondents provide. In particular, it has been shown that vague and ambiguous terms are often interpreted idiosyncratically by respondents, and thus can introduce a systematic bias into the survey data. In addition to ambiguity, the cognitive effort required to understand survey questions may affect data quality in a similar way. This paper examines whether the cognitive burden imposed by unclear questions reduces the quality of respondents‟ answers. An experiment was carried out in which respondents were asked to complete two Web surveys at a two-week interval. Approximately half of the respondents answered questionnaires that included unclear and less comprehensible questions, the other half received control questions that were easier to comprehend. Indicators of response quality were drop-out rates, number of non-substantive responses, number of neutral responses, and over-time consistency. As expected, respondents receiving unclear questions provided lower-quality responses than respondents answering more comprehensible questions. Moreover, some of these effects were more pronounced among respondents with limited verbal skills and among respondents with low motivation to answer surveys.
WAPOR Homepage (abstract) / (full text)
Web survey bibliography - WAPOR 64th Annual Conference, 2011 (6)
- Establishing Cross-National Equivalence of Measures of Xenophobia: Evidence from Probing in Web Surveys...; 2011; Braun, M., Behr, D., Kaczmirek, L.
- “Don’t know” the difference - An experimental comparison between Web and CATI; 2011; Schielicke, A.-M., Degen, M.
- A Survey Stopping Rule Based on Weighting for Unit Nonresponse; 2011; Lewis, T.
- Classic Inspirations for Social Research Methodology in the time of Online Access Panels ; 2011; Jerabek, H.
- Question Comprehensibility and Satisficing Behavior in Web Surveys; 2011; Lenzner, T.
- Examination of a ’Web Mode Effect’. An Experimental Comparison of Web and Paper Based Surveys...; 2011; Shamshiri-Petersen, D., Clement, S. L.