Web Survey Bibliography
(a) Relevance & Research Question
High drop-out rates are considered a major shortcoming of web surveys and considerably threaten data quality. However, until recently survey breakoff has received limited scholarly attention and knowledge about the reasons causing respondents to terminate surveys early is still fractional. In political science, the topic has been particularly neglected. Enhanced understanding of the complex processes leading to breakoff is needed in order to develop standard guidelines for web surveys that help in minimising drop-out rates.
(b) Methods & Data
Connected to the German Longitudinal Election Study (GLES) a seven-wave campaign online tracking has been conducted with about 14,000 respondents, thereof 3,000 drop-outs. This data allows for a detailed analysis of drop-outs: Given the applied quota design, personal information is available even about those respondents who answered some questions but did not finish the survey. As many questions were included in each wave, yet being asked at different questionnaire positions and being surrounded by various items, contextual effects on drop-out can be analysed.
In terms of research methods, among other things, life tables were presented to observe how breakoffs are distributed throughout the survey. Discrete-time survival models with page-varying covariates are estimated for each wave separately, including both respondent characteristics as well as questionnaire and page characteristics.
(c) Results
Our main findings can be summarised as follows:
In accordance with recent research, we find drop-out to be a function of both respondent characteristics and page characteristics. For instance, higher educated people are less likely to break off, whereas open questions tend to produce significantly higher drop-outs.
In the course of the survey, the drop-out-risk tends to decrease.
Varying the context a question is embedded in, may affect the number of drop-outs, thus breakoff in web surveys is not unchallengeable.
(d) Added Value
Our findings confirm some results of previous research dealing with breakoff in web surveys. The reasons for breakoffs thus seem to be largely independent of the survey topic. Even more essential, based on the empirical results, some prospects for reducing the number of drop outs in web surveys by questionnaire and page design are provided.
Conference Homepage (abstract) / (presentation)
Web survey bibliography - Steinbrecher, M. (4)
- Why Do Respondents Break Off Web Surveys and Does It Matter? Results From Four Follow-up Surveys; 2014; Rossmann, J., Blumenstiel, J. E., Steinbrecher, M.
- The Short-term Campaign Panel of the German Longitudinal Election Study 2009. Design, Implementation...; 2013; Steinbrecher, M., Rossmann, J.
- A new approach to the analysis of survey drop-out. Results from Follow-up Surveys in the German Longitudinal...; 2011; Rossmann, J., Blumenstiel, J. E., Steinbrecher, M.
- Breakoff in Web Surveys of the German Longitudinal Election Study (GLES); 2010; Blumenstiel, J. E., Roßmann, J., Steinbrecher, M.