Web Survey Bibliography
When survey respondents are faced with long, cognitively demanding interviews, they may take measures to reduce their cognitive burden. In particular, when questions are presented in a predictable pattern, it is relatively easy for respondents to learn that certain behaviors will help them get to the end of the interview more quickly. One frequently-used pattern is to ask questions in an interleafed format, in which each question in a series of filter items is succeeded by follow-up questions only if the individual responds affirmatively to the filter. In such cases, respondents may learn that negative responses to filter questions help them end the interview more quickly. Such underreporting can lead to biased survey estimates.
This presentation will report on the results of two recent surveys of members of a probability-based web panel in which respondents were asked a series of advertising recall questions in an interleafed format. The order of the ads was randomly assigned for each respondent and recorded. Preliminary results of this study show that later placement in the order of presentation has a significant, negative impact on reported ad recall. This presentation will also discuss the effect of respondent demographics and interest in the survey topic on the extent of underreporting, as well as the impact of length of time spent in the panel. Implications for existing survey practice and directions for future research will be discussed.
Conference Homepage (abstract)
Web survey bibliography - Medway, R. (6)
- Mixing Modes: Challenges (and Tradeoffs) of Adapting a Mailed Paper Survey to the Web ; 2016; Wilkinson-Flicker, S.; McPhee, C. B.; Medway, R.; Kaiser, A.; Cutts, K.
- Providing a Deadline for Response: Results from Two Recent Experiments; 2014; Kaiser, A., Walston, J. T., Medway, R., Ye, C., Tourangeau, R.
- The Relations Among Different Cognitive Shortcuts in Surveys; 2013; Tourangeau, R., Medway, R., Presser, S.
- The Impact on Web Survey Drop-Out Rates of Page Number Progress Indicators Used Throughout, Near the...; 2013; Walston, J. T., Cunningham, B., Medway, R.
- Underreporting in Interleafed Questionnaires: Evidence from Two Web Surveys; 2011; Medway, R., Viera Jr., L., Turner, S., Marsh, S. M.
- Evaluation of Measurement Equivalence for a Web-Based Survey with Paper Survey Option; 2009; Gibson, J., Turner, S., Marsh, S., Medway, R.