Web Survey Bibliography
Many studies found that the wording of a survey question can influence the answers that respondents provide. In particular, it has been shown that vague and ambiguous terms are often interpreted idiosyncratically by respondents, and thus can introduce a systematic bias into the survey data. In addition to ambiguity, the cognitive effort required to understand survey questions may affect data quality in a similar way. This paper examines whether the cognitive burden imposed by unclear questions reduces the quality of respondents‟ answers. An experiment was carried out in which respondents were asked to complete two Web surveys at a two-week interval. Approximately half of the respondents answered questionnaires that included unclear and less comprehensible questions, the other half received control questions that were easier to comprehend. Indicators of response quality were drop-out rates, number of non-substantive responses, number of neutral responses, and over-time consistency. As expected, respondents receiving unclear questions provided lower-quality responses than respondents answering more comprehensible questions. Moreover, some of these effects were more pronounced among respondents with limited verbal skills and among respondents with low motivation to answer surveys.
WAPOR Homepage (abstract) / (full text)
Web Survey Bibliography - Online qualitative research (761)
- Does survey experience affect respondents’ reported level of satisfaction?; 2012; Schultz Christensen, A., Ladenburg, J.
- Evaluation of an online (opt-in) panel for public participation geographic information systems surveys...; 2012; Brown, G., Weber, D., Zanon, D., de Bie, K.
- Developing an Online GIS-based Survey Instrument to Elicit Perceived Neighborhood Information for Environmental...; 2012; Carr, J., Johnson, I., Keene, R., Landry, P., Gradeck, R., Lucht, J., Beach, S., Clougherty, J.
- Studying Migrants with the Help of the Internet: Methods from Psychology; 2012; Reips, U. -D., Buffardi, L.
- Panel Conditioning in Online Survey Panels: Problems of Increased Sophistication and Decreased Engagemeent...; 2012; Adams, A. N., Atkeson, L. R., Karp, J. A.
- Efficiency of Different Recruitment Strategies for Web Panels; 2012; Hansen, K. M., Pedersen, R. T.
- Improving Representativeness In Online Surveys Using A Combined Internet/Postal Approach: Evidence From...; 2012; Atorough, P., Donaldson, B., Harris, A.
- Surveying Rare Populations Using a Probabilitybased Online Panel; 2012; Peugh, J., Wright, G.
- Nonresponse and Online Student Evaluations of Teaching: Understanding the Influence of Salience...; 2012; Adams, M. J. D., Umbach, P. D.
- Innovation der Online-Datenerhebung für wissenschaftliche Forschungen. Das niederländische MESS-Projekt...; 2012; Das, M.
- Do Questions about Watching Internet Pornography Make People Watch Internet Pornography? A Comparison...; 2012; Peter, J., Valkenburg, P. M.
- “I think I know what you did last summer” Improving data quality in panel surveys; 2012; Lugtig, P. J.
- Understanding Society Innovation Panel Wave 4: Results from Methodological Experiments; 2012; Burton, J., Budd, S., Gilbert, E., Jaeckle, A., Kaminska, O., Uhrig, S.C. N., Brown, M., Calderwood,...
- The Propensity of Older Respondents to Participate in a General Purpose Survey; 2012; Lynn, P.
- Mode-Switch Protocols: How a Seemingly Small Design Difference can affect Attrition Rates and Attrition...; 2012; Lynn, P.
- Deep Data: Qualitative Approaches to E-Research in the Digital Age; 2012; Salmons, J.
- Going online with a face-to-face household panel: Initial results from an experiment on the UK Household...; 2012; Jaeckle, A., Lynn, P., Burton, J.
- The use of new technologies on the British Birth Cohort Studies; 2012; Calderwood, L.
- Online Data Collection in the Agro-Food Sector; 2012; Biffignandi, S., Artaz, R.
- Reaching Under/Never Screened Populations Using an Online Survey; 2012; Filsinger, B., Gesink, D., Mihic, A., Kreiger, N.
- Comparing Ranking Techniques in Web Surveys; 2012; Blasius, J.
- Surveying general population: What types of experiments are further needed?; 2012; Vehovar, V., Berzelak, N.
- Psychometric properties of an internet administered version of the Marlowe-Crowne Social Desirability...; 2012; Vesteinsdottir, V., Reips, U. -D., Joinson, A. N., Porsdottir, F.
- Research design for studying online communities with web surveys; 2012; Petrovcic, A., Petric, G., Lozar Manfreda, K.
- “What a waste of time!” vs “Why not participate?” On sentiments by business...; 2012; Torres van Grinsven, V., Snijkers, G., Daas, P.
- Effect of different stimulus on data quality in online panels; 2012; Zagar, S., Lozar Manfreda, K.
- GESIS Online Access Panel Pilot Study: Recruitment and Panel Maintenance; 2012; Kaczmirek, L., Bandilla, W., Schaurer, I., Struminskaya, B., Weyandt, K.
- The German Internet Panel: First Results from the Recruitment Phases; 2012; Blom, A. G.
- Panel retention rate and data quality: experimental results drawing on Reciprocity design; 2012; Biffignandi, S., Artaz, R.
- Analysis of coverage bias for the implementation of web surveys in Spain; 2012; de Pedraza, P., Serrano, F.
- Web panels in Slovenia; 2012; Lenar, J., Vehovar, V.
- Adaptation of Cognitive Interviews for Web; 2012; Mohorko, A., Hlebec, V.
- Database Lookup in Web Surveys; 2012; Couper, M. P., Zhang, C., Conrad, F. G., Tourangeau, R.
- Solving the Mode Mystery The Cost, Coverage and Quality Tradeoffs of Picking (and Mixing) Online and...; 2012; Cape, P. J., Phillips, K.
- A report on the Confirmit Market Research Software Survey ; 2012; Macer, T., Wilson, S.Wilson, Sheila
- A beginner's guide to DIY research ; 2012; Cates, T.
- Why "mobile" (as we know it) is the wrong focus ; 2012; Smithee, B.
- Qualitatively Speaking: Mobile qualitative finally hits its stride; 2012; Bryson, J.
- Comfortable in the new medium: How online qual can benefit from our share-happy culture ; 2012; Rubenstein, P.
- Don't rush through the qualitative screening process ; 2012; Dodson, D.
- Appreciating the value of traditional research in a digital world; 2012; Turner, S.
- Mixing old and new qualitative methods ; 2012; Kaisner, C., Lindley , K.
- For winning qualitative, make it high-touch + high-tech; 2012; Barber, E., McIlrath, M.
- Sample Survey on Sensitive Topics: Investigating Respondents’ Understanding and Trust in Alternative...; 2012; De Schrijver, A.
- Preventative care to extend panelist’s lifetime: A driver analysis on panelist engagement; 2012; Johnson, E. P., Schiers, J.
- Consistency in Global Non-Probabilistic Online Samples; 2012; Gittelman, S. H., Trimarchi, E.
- How Online Technology May Open The Door to More Integrated Qual/Quant Research; 2012; Brandt, D., Markowitz, L.
- Innovation in online data collection for scientific research: the Dutch MESS project; 2012; Das, M.
- Clinicians’ Perspectives on a Web-Based System for Routine Outcome Monitoring in Old-Age Psychiatry...; 2012; Veerbeek, M. A., Voshaar, R. C. O., Pot, A. M.
- The Effectiveness of Survey Recruitment Methods in Second Life; 2012; Dean, E., Cook, S., Murphy, J., Keating, M.

