Web Survey Bibliography
Many studies found that the wording of a survey question can influence the answers that respondents provide. In particular, it has been shown that vague and ambiguous terms are often interpreted idiosyncratically by respondents, and thus can introduce a systematic bias into the survey data. In addition to ambiguity, the cognitive effort required to understand survey questions may affect data quality in a similar way. This paper examines whether the cognitive burden imposed by unclear questions reduces the quality of respondents‟ answers. An experiment was carried out in which respondents were asked to complete two Web surveys at a two-week interval. Approximately half of the respondents answered questionnaires that included unclear and less comprehensible questions, the other half received control questions that were easier to comprehend. Indicators of response quality were drop-out rates, number of non-substantive responses, number of neutral responses, and over-time consistency. As expected, respondents receiving unclear questions provided lower-quality responses than respondents answering more comprehensible questions. Moreover, some of these effects were more pronounced among respondents with limited verbal skills and among respondents with low motivation to answer surveys.
WAPOR Homepage (abstract) / (full text)
Web Survey Bibliography - Lenzner, T. (8)
- An Evaluation of Two Non-Reactive Web Questionnaire Pretesting Methods; 2012; Lenzner, T.
- Online Research @ GESIS; 2011; Kaczmirek, L., Lenzner, T.
- A Psycholinguistic Look at Survey Question Design and Response Quality; 2011; Lenzner, T.
- Effects of survey question clarity on data quality; 2011; Lenzner, T.
- Question Comprehensibility and Satisficing Behavior in Web Surveys; 2011; Lenzner, T.
- Cognitive process in answering questions: Are verbal labels in rating scales attended to?; 2011; Menold, N., Kaczmirek, L., Lenzner, T.
- Left feels right! The optimal position of answer boxes in Web surveys; 2011; Galesic, M., Kaczmirek, L., Lenzner, T., Merkert, M.
- Cognitive burden of survey questions and response times: A psycholinguistic experiment; 2010; Lenzner, T., Kaczmirek, L., Lenzner, A.