Web Survey Bibliography
As more survey modes have become available, it has ever been an aspiration in survey methodology research to test and assure comparability of measurements obtained in different modes. Such research has often found 'mode effects’, which are measurement differentials between modes beyond sampling variation. Moreover, with the rise of the mixed-mode survey, which combines more than one survey mode in the data collection design , the question of comparability has become even more pressuring.
The reason why estimates based on different survey modes are known to differ is bias introduced by mode-specific survey nonresponse and mode-specific measurement error. The major problem in such research has remained, however, that these errors are confounded in studies experimentally comparing two or more survey modes. Comparative studies therefore should strive to control for mode-specific nonresponse before observing residual measurement differentials.
We review commonly used techniques useful for this goal and then present results from an experiment, in which the same survey project was administered in four different modes (CAPI, CATI, CAWI, and PAPI). About 8000 respondents were randomly sampled from the Dutch population and assigned to one of the modes. In the analysis we use structural modeling to test measurement invariance across survey modes on a set of items taken from round five of the European Social Survey (ESS). We control for mode-specific survey nonresponse using auxiliary information from various registries . The adjustment is expected to be imperfect due to the typically low explanatory power of registry data; however, the adjustment situation is comparable to that encountered in practical fieldwork. Hence if measurement invariance between some modes is rejected , this will have strong implications for measurements realized in mixed-mode surveys and the practical researcher’s means to adjust for bias in mixed-mode surveys.
Conference Homepage (abstract)
Web survey bibliography - Klausch, L. T. (18)
- Mixed Mode Research: Issues in Design and Analysis; 2016; Hox, J.; De Leeuw, E. D.; Klausch, L. T.
- A look into the challenges of mixed-mode surveys; 2016; Klausch, L. T.
- Tracking the Representativeness of an Online Panel Over Time ; 2016; Klausch, L. T.; Scherpenzeel, A.
- Selection error in single- and mixed mode surveys of the Dutch general population; 2015; Hox, J., Klausch, L. T., Schouten, B.
- Evaluating mixed-mode redesign strategies against benchmark surveys: the case of the Crime Victimization...; 2014; Klausch, L. T., Hox, J., Schouten, B.
- The use of within-subject experiments for estimating measurement effects in mixed-mode surveys ; 2014; Klausch, L. T., Schouten, B., Hox, J.
- Pret met panels [Fun online]; 2013; Roberts, A., de Leeuw, E. D., Hox, J., Klausch, L. T., de Jongh, A.
- Leuker kunnen wij het wel maken. Online vragenlijst design: standaard matrix of scrollmatrix (We can...; 2013; Roberts, A., de Leeuw, E. D., Hox, J., Klausch, L. T., de Jongh, A.
- Measurement Effects of Survey Mode on the Equivalence of Attitudinal Rating Scale Questions; 2013; Klausch, L. T., Hox, J., Hox, J., Schouten, B.
- Estimating Measurement Effects of Survey Modes From Between and Within Subject Designs; 2013; Klausch, L. T., Hox, J., Schouten, B.
- Design of Web Questionnaires: Matrix Questions or Single Question Formats ; 2012; de Leeuw, E. D., Hox, J., Klausch, L. T., Roberts, A., de Jongh, A.
- Disentangling Mode-Specific Selection and Measurement Bias in Social Surveys; 2012; Buelens, B., van der Laan, J., Schouten, B., Klausch, L. T., van der Brakel, J., Burger, J.
- Assessing Measurement Equivalence and Bias of Questions in Mixed-mode Surveys Under Controlled Sample...; 2012; Klausch, L. T., Hox, J., Schouten, B.
- The Representativity of Web Surveys of the General Population compared to Traditional Modes and Mixed...; 2012; Klausch, L. T., Schouten, B., Hox, J.
- Matrix vs. Single Question Formats in Web Surveys: Results from a large scale experiment; 2012; Klausch, L. T., de Leeuw, E. D., Hox, J., de Jongh, A., Roberts , A.
- Disentangling relative mode effects for the web survey mode in the Safety Monitor; 2011; Schouten, B., van de Brakel, J., Buelens, B., Klausch, L. T., van der Laan, J.
- Respondent Characteristics as Explanations for Uninformative Survey Response: Sources of Nondifferentiation...; 2011; Van Meurs, L., Klausch, L. T., Schoenbach, K.
- Testing between-mode measurement invariance under controlled selectivity conditions; 2011; Klausch, L. T.