Web Survey Bibliography
In September of 2014, we conducted coordinated data collections using an ABS probability mail survey (Westat), a probability web survey (Pew Research Center), and a non-probability web survey using SurveyMonkey’s Audience panel (SurveyMonkey). A separate paper compares weighted estimates from these surveys, including comparisons to national benchmark estimates. This paper examines two statistical approaches that have been proposed to improve the quality of the estimates from non-probability samples. The first method involves using different weighting. Most weighting strategies have examined approaches intended to address coverage loss associated with lack of access or use of the internet. Propensity score weighting is one such approach. We explore alternative calibration weights, informed by data from the probability-based Westat and Pew surveys. The second approach is sample matching, where the respondents for the non- probability web survey are selected to match to targets from other samples or censuses. Since sample matching was not implemented in the SurveyMonkey web survey, we simulate this option by dropping observations from the data set so that the unweighted sample is more similar to observations from the probability mail survey. We explore the effects of both of these techniques by comparing the web survey estimates with and without the weighting and matching adjustments to the other probability sample estimates and benchmarks discussed above.
Web survey bibliography - Keeter, S. (9)
- Theory and Practice in Nonprobability Surveys: Parallels between Causal Inference and Survey Inference...; 2017; Mercer, A. W.; Kreuter, F.; Keeter, S.; Stuart, E. A.
- Decomposing Selection Effects in Non-probability Samples ; 2016; Mercer, A. W.; Keeter, S.; Kreuter, F.
- Methods can matter: Where Web surveys produce different results than phone interviews; 2016; Keeter, S.
- App vs. Web for Surveys of Smartphone Users: Experimenting with mobile apps for signal-contingent experience...; 2015; McGeeney, K.; Keeter, S.; Igielnik, R.; Smith, A.; Rainie, L.
- Advance Postcard Mailing Improves Web Panel Survey Participation; 2015; Bertoni, N.; Burkey, A.; Caldaro, M.; Keeter, S.; DiSogra, C.; McGeeney, K.
- A Comparison of Results from Surveys by the Pew Research Center and Google Consumer Surveys; 2012; Keeter, S., Christian, L. M.
- Assessing Cell Phone Noncoverage Bias Across Different Topics and Subgroups; 2010; Christian, L. M., Keeter, S., Purcell, K., Smith, A.
- Do Landline RDD Samples Adequately Cover the "Wireless Mostly"?; 2009; Dimock, M., Christian, L. M., Keeter, S.
- Cell-Phone-Only Voters in the 2008 Exit Poll and Implications for Future Noncoverage Bias ; 2009; Mokrzycki, M., Keeter, S., Kennedy, C.