Web Survey Bibliography
Title An Experimental Comparison of Three Modes of Data Collection Within the Eurobarometer Measurement Domain
Source RC33 6th International Conference on Social Science Methodology: Recent Developments and Applications in Social Research Methodology, 2004
Access date 14.09.2004
Abstract The growing number of methods of data collection and the rising popularity of mixed mode designs to increase timeliness, improve measurement error properties or reduce non-response or cost necessitate studying the effects of different methods of data collection on survey errors. With the increasing interest in cross cultural studies and the difficulties in employing the same method of data collection across countries due to economical or cultural challenges, there is a growing need to compare the major methods of data collection simultaneously and examine mode effects on a variety of question types. An experiment motivated by this need was conducted by Gallup-Europe in conjunction with the European Social Survey (ESS) in May-July, 2003. Four major modes, face-to-face, telephone, self-administered and web, were compared in two waves of data collection - a convenience quota sample of 1,987 respondents representative of the Hungarian urban population by age, sex and education was selected, randomly assigned to a mode, and then re-interviewed in a different mode. The second interview for some methods of data collection was randomly assigned to be either on location (a public location) or off location (the respondent’s home). The survey instrument included questions from the ESS and the Eurobarometer. The selection was driven by question type and topic with the intention of including socially desirable, sensitive, complex, open-ended, etc. items. Mode effects become visible when the different methods of data collection produce different response distributions. An explanatory model for responses can be employed adopting Lazersfeld’s latent class model (Saris and Hagenaars, 1997). If respondents’ probabilities to give particular responses vary across modes, then the observed response distributions will be different and these differences are not attributable to chance. The within subject design allows estimating the response probabilities from square tables, using the EM algorithm and employing different restrictions. A model assuming equal response probabilities between pairs of modes is tested first and evaluated based on the likelihood ratio test. When such a model does not fit, less restricted models that allow probabilities between modes to vary are tested. A final model is accepted on the basis of parsimony. This procedure is repeated for all questions and across all possible mode comparisons.
Year of publication2004
Bibliographic typeConferences, workshops, tutorials, presentations
Web Survey Bibliography - Tortora, R. D. (12)
- Attrition in Consumer Panels; 2009; Tortora, R. D.
- Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice...; 2009; Dillman, D. A., Phelps, G., Tortora, R. D., Swift, K., Kohrell, J., Berck, J., Messer, B. L.
- Recruitment and retention for a consumer panel; 2008; Tortora, R. D.
- Multiplicity-Based Sampling for the Mobile Telephone Population: Coverage, Nonresponse, and Measurement...; 2008; Tortora, R. D., Groves, R. M., Peytcheva, E.
- An Experimental Comparison of Three Modes of Data Collection Within the Eurobarometer Measurement Domain...; 2004; Peytcheva, E., Groves, R. M., Manchin, R., Tortora, R. D.
- Comparing Face to Face, Telephone, Paper Self-Administered, and Web Survey Measurement; 2004; Tortora, R. D., Groves, R. M., Peytcheva, E., Manchin, R.
- Response Rate and Measurement Differences in Mixed Mode Surveys Using Mail, Telephone, Interactive Voice...; 2001; Dillman, D. A., Phelps, G., Tortora, R. D., Swift, K., Kohrell, J., Berck, J.
- Incentives in Internet Surveys; 2001; Tortora, R. D.
- Principles for Constructing Web Surveys; 1998; Dillman, D. A., Tortora, R. D., Bowker, D.
- Principles for Constructing Respondent-Friendly WEB Surveys and Their Influence on Response; 1998; Dillman, D. A., Tortora, R. D.
- Influence of Plain Vs. Fancy Design on Response Rates for Web Surveys; 1998; Dillman, D. A., Tortora, R. D., Conradt, J., Bowker, D.
- CATI in an Agricultural Statistical Agency; 1985; Tortora, R. D.