Web Survey Bibliography
Online surveys continue to transform how survey research is conducted, not just in terms of the capabilities they offer, but also how online surveys are designed. Several companies have recently entered the survey research field with a new type of platform, offering researchers a do-it-yourself (DIY), cost-effective approach to surveying thousands of people online. Respondents to DIY surveys are recruited from an online panel of Internet users or by using a variety of online recruitment methods, including banner advertisements, email campaigns, and search campaigns (i.e., search engine generated links). A new recruitment approach for conducting DIY surveys has been gaining traction -- a “surveywall” that first intercepts Internet users attempting to access restricted/paid content from a participating website then solicits them to participate in a very brief survey (1-2 questions). Users are sampled in real-time and, in exchange for their survey participation, are given access to the paid content. Proponents of this DIY approach argue that by reducing survey burden, and simultaneously providing more meaningful incentives (i.e., access to content), survey results are as accurate as those derived from probability-based online panels. In this study, we test the feasibility and performance of intercept-type DIY survey relative to a probability-based online panel, a traditional opt-in online panel, and online populations recruited through two popular social media platforms using a common questionnaire. We provide an independent assessment, useful to those studying and contemplating using such a system. We compare responses from all platforms to demographic and behavioral benchmarks, using the average percentage point absolute error across all the questions in the survey, as done by McDonald, Mohebbi, and Slatkin (2012) and Yeager, Krosnick, et al. (2011) in their comparative research on survey accuracy. We discuss the findings from the study and conclude with a call and recommendations for further research on this topic.
Conference Homepage (abstract)
Web survey bibliography - Murphy, J. (11)
- A Comparison of Emerging Pretesting Methods for Evaluating “Modern” Surveys; 2017; Geisen, E., Murphy, J.
- Comparing Twitter and Online Panels for Survey Recruitment of E-Cigarette Users and Smokers; 2016; Guillory, J.; Kim, A.; Murphy, J.; Bradfield, B.; Nonnemaker, J.; Hsieh, Y. P.
- A Test of Web/PAPI Protocols and Incentives for the Residential Energy Consumption Survey ; 2016; Biemer, P. P.; Murphy, J.; Zimmer, S.; Berry, J.; Lewis, K.; Shaofen, D.
- Problems and Prospects in Survey Research; 2016; Moy, P.; Murphy, J.
- Using respondent tweets to fill in survey gaps; 2014; Murphy, J.
- Mobile Technologies for Conducting, Augmenting and Potentially Replacing Surveys: Report of the AAPOR...; 2014; Link, M. W., Murphy, J., Schober, M. F., Buskirk, T. D., Childs, J. H., Tesfaye, C.
- Social Media, Sociality, and Survey Research; 2013; Hill, C., Dean, E., Murphy, J.
- Evaluation of a Sequential Mixed-Mode Design Experiment with Physicians on Response Rates, Costs, and...; 2013; Geisen, E., Olmsted, M. G., Murphy, J., Stanley, M.
- Surveywalls: A Breakthrough for Survey Customers or DIY Run Amok?; 2013; Wells, T., Dean, E., Rao, K., Murphy, J., Roe, D. J.
- Statisticians don’t like non-probability; 2012; Murphy, J.
- The Effects of Web and Mail Mixed-Mode Approaches on Response Rates in a Survey of Physicians; 2009; McFarlane, E., Murphy, J., Olmsted, M. G., Severance, J.