Web Survey Bibliography
The role of panelist engagement on survey data quality in online panels has been a subject of discussion and com-mendation by industry and academic leaders (see Baker et. al. 2010). While there are many indicators of data quality in on-line surveys such as item nonresponse (Rao and Gravelle 2008) and breakoffs (Peytchev 2009; Heerwegh and Loosveldt 2006), one in particular has gained some attention in recent times: survey completion time. Much of this attention is coming in light of the scrutiny facing online panels today on the issue of panelists participating in numerous surveys in short time periods that suggests their motive for maximizing returns (i.e. incentives) while minimizing survey effort. Termed colloquially as “Speeders,” survey respondents who complete a survey more rapidly compared to the norm are the target of investi-gation in this study. The data behind this study come from an online mobile phone usage survey sourced from several online sample vendors. In addition to computing an index of speeding, we analyze the relationship between speeding and other data quality measures in order to test the popular notion that speeders provide lower quality data than their non-speeding counterparts. Furthermore, we investigate the variation of the index score for speeding across different samples, taken as a whole or as a random subsample within each sample. Lastly, using a multivariate framework, we analyze the demographic predictors of speeding after controlling for sample source and respondents’ mobile phone service characteristics. In addition to presenting quantitative evidence of the effect of speeding on data quality, this article concludes with a call for further research on the role of speeding in online panel surveys and recommendations for future research.
Conference Homepage (abstract) / (presentation)
Web survey bibliography - Wells, T. (10)
- Evaluating Visual Design Elements for Data Collection and Panelist Engagement; 2015; Christian, L. M.; Harm, D.; Langer Tesfaye, C.; Wells, T.
- Comparing Tablet, Computer, and Smartphone Survey Administrations; 2013; Wells, T., Bailey, J., Link, M. W.
- Surveywalls: A Breakthrough for Survey Customers or DIY Run Amok?; 2013; Wells, T., Dean, E., Rao, K., Murphy, J., Roe, D. J.
- A Direct Comparison of Mobile Versus Online Survey Modes; 2012; Wells, T., Bailey, J., Link, M. W.
- Catch Them When You Can: Speeders and Their Role in Online Data Quality; 2011; Gutierrez, C., Wells, T., Rao, K., Kurzynski, D.
- Representing Seniors in an Online National Probability Panel Survey: Measuring Technology Attitudes...; 2010; Peugh, J., Mansfield, W., Wells, T., Semans, K.
- The Challenge and Importance of Including Spanish- Dominant Latinos in Online Panel Studies Addressing...; 2009; DiSogra, C., Wells, T., Torres, J.
- The Challenge and Importance of Including Spanish-Dominant Latinos in an Online Panel; 2009; Dennis, J. M., Wells, T., Torres, J.
- Is the digital divide still closing? New evidence points to skewed online results absent non-Internet...; 2008; Callegaro, M., Wells, T.
- Effects of Pre-coding Response Options for Five Point Satisfaction Scale in Web Surveys; 2008; Callegaro, M., Wells, T., Kruse, Y.