Web Survey Bibliography
One argument in favour of mixing modes of data collection in surveys is that using a combination of modes may help to reduce the likelihood of non
‐response bias by encouraging a potentially greater number and wider range of respondents to participate. Meanwhile, a strong argument against mixed mode surveys is that using different methods to collect data from different sample members can introduce differential measurement errors, confounding comparisons across groups. Understanding the necessary trade‐off between different sources of error is essential if survey designers are to make informed decisions about whether or not to mix modes. In this paper, I investigate the effects of mode on nonresponse and measurement error in two implementations of the European Social Survey (ESS) conducted in Switzerland: 1) the standard round 3 face‐to‐face survey; and 2) a trial version of the survey conducted alongside round 3 by telephone. I compare patterns of nonresponse on both surveys and, controlling for differences in the composition of the achieved samples, explore the extent of differential measurement error across the two modes. The presence of bias resulting from both error sources is assessed through comparisons with benchmark statistics. Using paradata from both surveys, comparisons are also made between subgroups of respondents distinguished on the basis of the level of effort required to secure their participation in the survey (i.e. number of contact attempts, refusal conversion efforts) to draw conclusions about the potential costs and benefits of using additional modes on the ESS as a way of managing total survey error.
Conference homepage (abstract)
Web survey bibliography - Roberts, C. (9)
- Mode Effects on Subjective Well-being Research: Do they Affect Regression Coefficients? ; 2016; Sanchez Tome, R.; Roberts, C.; Staehli, M. E.; Joye, D.
- Mixing modes of data collection in Swiss social surveys: Methodological report of the LIVES-FORS mixed...; 2016; Roberts, C.; Joye, D.; Staehli, M. E.
- Nonresponse and measurement error in an online panel; 2014; Roberts, C., Allum, N., Sturgis, P.
- Participation and engagement in web surveys of the general population: An overview of challenges and...; 2013; Roberts, C.
- User’s Guide to the Advance Release of the 2008-2009 ANES Panel Study ; 2009; DeBell, M.; Krosnick, J. A.; Lupia, A.; Roberts, C.
- Mode effects in Switzerland: non‐response and measurement error on the European Social Survey; 2009; Roberts, C.
- Mixing modes of data collection in surveys: A methodological review; 2007; Roberts, C.
- Telephone versus Face-to-Face Interviewing: Mode Effects on Data Quality and Likely Causes. Report...; 2006; Jaeckle, A., Lynn, P., Roberts, C.,
- Expert workshop on mixed mode data collection in comparative social surveys; 2005; Roberts, C.