Web Survey Bibliography
This paper examines the issue of whether some respondents are consistently “bad” respondents, who use a variety of methods to get through a questionnaire quickly and provide data of dubious value. We examine a wide range of cognitive shortcuts, including choosing the first and last response options, yea-saying, giving don’t know and no opinion responses, nondifferentiation among answers to similar questions, reporting numerical answers as round values, and selecting status quo responses. Some of these are forms of survey satisficing but others are not. The data include responses from national face-to-face, telephone, and Web surveys. Across all three modes, we find little evidence that respondents who exhibit a high rate of shortcuts in the first half of a questionnaire also exhibit a high rate in the second half. In addition, we find weak correlations among the various forms of shortcutting. It could be that respondents have preferred modes for coping with the demands of survey questions, with some preferring DK responses, others non-differentiation, and still others yea-saying. Another possibility is that item characteristics (which affect how interesting and difficult an item is for different respondents) play a more important role in determining the level of shortcutting than respondent characteristics. A final possibility is that these shortcuts do not represent a single phenomenon, but are at best loosely related strategies for dealing with survey questions. We do not find consistent relations between any respondent variables (such as educational attainment) and any of our measures of the use of shortcuts.
Conference Homepage (abstract)
Web survey bibliography - Medway, R. (6)
- Mixing Modes: Challenges (and Tradeoffs) of Adapting a Mailed Paper Survey to the Web ; 2016; Wilkinson-Flicker, S.; McPhee, C. B.; Medway, R.; Kaiser, A.; Cutts, K.
- Providing a Deadline for Response: Results from Two Recent Experiments; 2014; Kaiser, A., Walston, J. T., Medway, R., Ye, C., Tourangeau, R.
- The Relations Among Different Cognitive Shortcuts in Surveys; 2013; Tourangeau, R., Medway, R., Presser, S.
- The Impact on Web Survey Drop-Out Rates of Page Number Progress Indicators Used Throughout, Near the...; 2013; Walston, J. T., Cunningham, B., Medway, R.
- Underreporting in Interleafed Questionnaires: Evidence from Two Web Surveys; 2011; Medway, R., Viera Jr., L., Turner, S., Marsh, S. M.
- Evaluation of Measurement Equivalence for a Web-Based Survey with Paper Survey Option; 2009; Gibson, J., Turner, S., Marsh, S., Medway, R.