Web Survey Bibliography
Satisficing behavior is a widespread hazard in Web surveys because interview supervision is limited in absence of a human interviewer. Therefore, it is important to devise methods which help to identify and to mitigate satisficing. The paper examines whether innovative questionnaire design can be an efficient means to detect satisficing and to reduce measurement error resulting from non-substantial answers, non-differentiation in matrix questions, and speeding. It analyzes to what extent these types of satisficing can be minimized by using three tools suggested in recent research. First, several studies use prompts to reduce the incidence of non-substantial answers. Second, some authors propose alternative designs for matrix questions (so-called scrolling matrix questions) to mitigate response non-differentiation. Third, control questions (or instructional manipulation checks) are intended to identify inattentive respondents.
The statistical analyses rely on data from two Web surveys of respondents from a probability-based and a non-probability online panel, respectively. Each of the design innovations is randomly assigned to half of the sample while the other half of the sample acts as the control group. The results of the experimental manipulations are presented and a multivariate regression model for satisficing behavior is estimated to test whether the design innovations contribute to the explanation of satisficing if we control for respondent characteristics which are predictive of satisficing. The paper concludes with an assessment of the potentials of the three tools to increase data quality and a discussion of their advantages and pitfalls.
Homepage of Conference (Abstract & Programme)
Web survey bibliography - Rossmann, J. (9)
- Why Do Respondents Break Off Web Surveys and Does It Matter? Results From Four Follow-up Surveys; 2014; Rossmann, J., Blumenstiel, J. E., Steinbrecher, M.
- Using Paradata to Predict and to Correct for Panel Attrition in a Web-based Panel Survey; 2014; Rossmann, J., Gummer, T.
- The Short-term Campaign Panel of the German Longitudinal Election Study 2009. Design, Implementation...; 2013; Steinbrecher, M., Rossmann, J.
- Identifying and Mitigating Satisficing in Web Surveys: Some Experimental Evidence; 2013; Rossmann, J.
- Identifying Satisficing Respondents in Web Surveys: A Comparison of Different Response Time-Based Approaches...; 2013; Rossmann, J.
- Interview Duration in Web Surveys: Integrating Different Levels of Explanation; 2013; Rossmann, J., Gummer, T.
- Does Mode Matter? Initial Evidence from the German Longitudinal Election Study (GLES); 2012; Blumenstiel, J. E., Rossmann, J.
- A new approach to the analysis of survey drop-out. Results from Follow-up Surveys in the German Longitudinal...; 2011; Rossmann, J., Blumenstiel, J. E., Steinbrecher, M.
- Breakoff in Web Surveys of the German Longitudinal Election Study (GLES); 2010; Blumenstiel, J. E., Roßmann, J., Steinbrecher, M.