Web Survey Bibliography
Title Instant Interactive Feedback in Grid Questions: Reminding Web Survey
Year 2014
Access date 08.09.2014
Abstract
Interactive Web-based surveys permit direct interventions depending on respondents’ behaviors similar to interviewer-administered surveys. Previous findings on interactive feedback addressing speeding and nondifferentiation in grid questions showed that prompts slowed down response times and reduced straight-lining in later grid questions without increasing the risk of survey breakoff (Conrad et al., 2009, 2011; Zhang, 2012, 2013). Although these findings are promising, effects of interactive feedback on the prevention of satisficing behaviors in grid questions are rather small. This may be due to the fact that these studies used either a pop-up window or a follow-up Web page to deliver the interactive feedback to respondents. Thus, respondents were supposed to actively return to the grid affected by speeding or nondifferentiation. By contrast, the present experiments implemented interactive feedback that was instantly triggered depending on respondents’ satisficing behaviors, i.e., speeding and nondifferentiation while the respondents were still answering a particular grid question. The underlying idea was that feedback provided instantly while the items were still being answered can address satisficing behaviors more efficiently as compared to delayed feedback provided after the grid was submitted. In a randomized field experimental Web survey conducted among study applicants (n=7454), a between-subjects design was implemented to test the effect of instant interactive feedback with two different kinds of messages asking respondents to either take more time to answer (experiment 1) or to differentiate more between responses to items of the same grid (experiment 2). Initial findings indicated that speeding and nondifferentiation were significantly reduced by either feedback message. Furthermore, effects carried over to later questions. These results suggest that instant interactive feedback has the potential to induce immediate and sustainable improvements in respondent behavior. In addition, results are discussed in view of the precise timing of feedback to obtain best possible effects concerning improved data quality.
Access/Direct link
Year of publication2014
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - The American Association for Public Opinion Research (AAPOR) 69th Annual Conference, 2014 (20)
- Investigating Response Quality in Mobile and Desktop Surveys: A Comparison of Radio Buttons, Visual...; 2014; Toepoel, V.; Funke, F.
- Assessing the Impact Device Choice Has on Web Survey Data Collection ; 2014; Hupp, A.; Schroeder, H. M.; Piskorowski, A.D.
- Understanding Mobility: Consent and Capture of Geolocation Data in Web Surveys; 2014; Crawford, S. D.; McClain, C.; Young, R.H.; Nelson, T. F.
- Instant Interactive Feedback in Grid Questions: Reminding Web Survey; 2014; Kunz, T., Fuchs, M.
- What Does the Satisfaction with Democracy Measure Mean to Respondents in Different Countries? How Cross...; 2014; Behr, D., Braun, M.
- Using Eye Tracking to Evaluate Email Notifications of Surveys and Online Surveys Collecting Address...; 2014; Olmsted, E. L., Nichols, E. M.
- Respondent Processing of Multiple Images throughout a Web Survey; 2014; Charoenruk, N., Stange, M.
- Using Eye Tracking to Examine the Visual Design of Web Surveys; 2014; Zhou, Q., Ricci, K., Olson, K., Smyth, J. D.
- Achieving Balance: Understanding the Relationship between Complexity and Response Quality; 2014; Kirchner, A., Powell, R.
- Question Grouping and Matrices in Web Surveys: Using Response and Auxiliary Data to Examine Question...; 2014; Bilgen, I., Stern, M. J.
- The Grouping of Items in Mobile Web Surveys; 2014; Mavletova, A. M., Couper, M. P.
- Evaluating the Efficacy of Mixed-Mode Intercept Surveys for Complex Questionnaires; 2014; Puniello, O. T.
- Experiments with Email Formatting; 2014; Lawrence, S., Phillips, B. T.
- Sequential or Simultaneous Multi-Mode? Results from Two Large Surveys of Electric Utility Consumers; 2014; Jackson, C., Ledoux, C.
- Correlates of Attrition in the German Internet Panel: Drop-Outs and Sleepers; 2014; Blom, A. G., Beissel-Durrant, G.
- Survey Breakoff in Online Panels; 2014; McCutcheon, A. L.
- Measuring Nonresponse Bias in Web Surveys: The Role of Health Status; 2014; Zhang, M.
- Providing a Deadline for Response: Results from Two Recent Experiments; 2014; Kaiser, A., Walston, J. T., Medway, R., Ye, C., Tourangeau, R.
- Respondents Playing Fast and Loose?: Antecedents and Consequences of Respondent Speed of Completion; 2014; Thomas, R. K., Barlas, F. M.
- A Glimpse Inside the Mind of a Respondent: Using Paradata to Improve Online Surveys; 2013; Pape, T.; Barron, S.