Web Survey Bibliography
The interactivity of the Web can be harnessed to improve online response quality. A small body of research has begun to explore interactive prompts to reduce respondent satisficing, i.e., providing adequate but not optimal answers. For example, in our earlier work speeding (responding very quickly), is reduced with an interactive, textual prompt when responses are very fast (< 1/3 second per word). These and other studies have focused on one satisficing behavior, although it’s likely respondents who engage one satisficing behavior engage in other such behaviors while completing the questionnaire. In fact, emerging evidence suggests a strong correlation between two well-known satisficing behaviors in Web surveys—speeding and non-differentiation (giving very similar ratings in grid questions). Given that both speeding and non-differentiation are prominent satisficing behaviors, which one should be addressed through prompting and does prompting one behavior over the other differently impact data quality? We tested this in an experiment using a probability-based online panel. We compare two types of prompts in a series of grid questions, one targeting only speeding and the other only nondifferentiation (we also include a control condition of no prompt). We find that prompting either speeding or non-differentiation can curtail both behaviors on grid questions. This reflects the inherent correlation of these two satisficing behaviors, and more importantly, suggests that both prompts indeed lead to more thoughtful answers (in contrast to if the two types of prompts only had parallel effects where speeding prompts only reduced speeding and vice versa). In addition, both prompts seem to enhance the quality of answers other than grid questions, suggesting potentially broad effects on respondent performance. We will also report evidence about the impact of prompts on respondents’ behaviors in subsequent surveys of this panel, and whether any carry-over effects differ between the two types of prompts.
Conference Homepage (abstract)
Web survey bibliography - Zhang, C. (16)
- Reducing speeding in web surveys by providing immediate feedback; 2017; Conrad, F.; Tourangeau, R.; Couper, M. P.; Zhang, C.
- Respondent mode choice in a smartphone survey ; 2017; Conrad, F. G., Schober, M. F., Antoun, C., Yan, H. Y., Hupp, A., Johnston, M., Ehlen, P., Vickers, L...
- Helping respondents provide good answers in Web surveys; 2016; Couper, M. P.; Zhang, C.
- Comparisons of Online Recruitment Strategies for Convenience Samples: Craigslist, Google AdWords, Facebook...; 2016; Antoun, C., Zhang, C., Conrad, F. G., Schober, M. F.
- A Review of Issues in Gamified Surveys; 2015; Keusch, F.; Zhang, Che.
- Speeding in Web Surveys: The tendency to answer very fast and its association with straightlining; 2013; Conrad, F. G.; Zhang, Che.
- Satisficing in Web Surveys: Implications for Data Quality and Strategies for Reduction; 2013; Zhang, Che.
- Speeding and Non-Differentiation in Web Surveys: Evidence of Correlation and Strategies for Reduction...; 2013; Zhang, Che.
- Evaluating Interactive Feedback in Computer-Assisted Self-Interviewing (CASI); 2013; Hudson, M. L., Hupp, A., Zhang, C., Schroeder, H. M.
- Database Lookup in Web Surveys; 2012; Couper, M. P., Zhang, C., Conrad, F. G., Tourangeau, R.
- Designing Interactive Interventions in Web Surveys: Humanness, Social Presence and Data Quality; 2012; Zhang, Che.
- Impact on Data Quality of Making Incentives Salient in Web Survey Invitations.; 2011; Zhang, Che.
- Professional Web Respondents and Data Quality; 2010; Conrad, F. G., Tourangeau, R., Couper, M. P., Zhang, C.
- Differences Between Internet and Non-Internet Households on Survey Items: Do These Differences Disappear...; 2009; Zhang, C., Callegaro, M., Thomas, M.
- Do we hear different voices?: Investigating the differences between internet and non-internet users...; 2009; Zhang, C., Callegaro, M., Thomas, M., DiSogra, C.
- More than the digital divide?: Investigating the differences between Internet and non-Internet users; 2008; Zhang, C., Callegaro, M., Thomas, M.