Web Survey Bibliography
Title An Experimental Comparison of Three Modes of Data Collection Within the Eurobarometer Measurement Domain
Source RC33 6th International Conference on Social Science Methodology: Recent Developments and Applications in Social Research Methodology, 2004
Access date 14.09.2004
Abstract The growing number of methods of data collection and the rising popularity of mixed mode designs to increase timeliness, improve measurement error properties or reduce non-response or cost necessitate studying the effects of different methods of data collection on survey errors. With the increasing interest in cross cultural studies and the difficulties in employing the same method of data collection across countries due to economical or cultural challenges, there is a growing need to compare the major methods of data collection simultaneously and examine mode effects on a variety of question types. An experiment motivated by this need was conducted by Gallup-Europe in conjunction with the European Social Survey (ESS) in May-July, 2003. Four major modes, face-to-face, telephone, self-administered and web, were compared in two waves of data collection - a convenience quota sample of 1,987 respondents representative of the Hungarian urban population by age, sex and education was selected, randomly assigned to a mode, and then re-interviewed in a different mode. The second interview for some methods of data collection was randomly assigned to be either on location (a public location) or off location (the respondent’s home). The survey instrument included questions from the ESS and the Eurobarometer. The selection was driven by question type and topic with the intention of including socially desirable, sensitive, complex, open-ended, etc. items. Mode effects become visible when the different methods of data collection produce different response distributions. An explanatory model for responses can be employed adopting Lazersfeld’s latent class model (Saris and Hagenaars, 1997). If respondents’ probabilities to give particular responses vary across modes, then the observed response distributions will be different and these differences are not attributable to chance. The within subject design allows estimating the response probabilities from square tables, using the EM algorithm and employing different restrictions. A model assuming equal response probabilities between pairs of modes is tested first and evaluated based on the likelihood ratio test. When such a model does not fit, less restricted models that allow probabilities between modes to vary are tested. A final model is accepted on the basis of parsimony. This procedure is repeated for all questions and across all possible mode comparisons.
Year of publication2004
Bibliographic typeConferences, workshops, tutorials, presentations
Web Survey Bibliography - Groves, R. M. (30)
- An Examination of Within-Person Variation in Response Propensity over the Data Collection Field Period...; 2012; Olson, K., Groves, R. M.
- Three Era's of Survey Research; 2011; Groves, R. M.
- Total Survey Error: past, present, and future; 2010; Groves, R. M., Lyberg, L. E.
- Total Survey Error: Past, Present, Future; 2009; Groves, R. M.
- The Presentation of a Web Survey, Nonresponse and Measurement Error among Members of Web Panel; 2009; Tourangeau, R., Groves, R. M., Kennedy, C., Yan, T.
- Use of Paradata to Manage a Field Data Collection; 2009; Groves, R. M., Axinn, W., Lepkowski, J. M., Kirgis, N., Mosher, W.
- The Collected Works of Robert M. Groves, 6 Book Set (Wiley Series in Survey Methodology); 2009; Groves, R. M.
- Experiments Exploring the Relationship (or Lack Thereof) Between Nonresponse Error and Measurement Error...; 2008; Tourangeau, R., Groves, R. M., Presser, S., Toppe, C., Kennedy, K., Yan, T.,
- Multiplicity-Based Sampling for the Mobile Telephone Population: Coverage, Nonresponse, and Measurement...; 2008; Tortora, R. D., Groves, R. M., Peytcheva, E.
- Survey Respondent Incentives: Research and Practice; 2008; Groves, R. M., Harris-Kojetin, L., Kulka, R. A., Mooney, G.
- The Impact of Nonresponse Rates on Nonresponse Bias; 2008; Groves, R. M., Peytcheva, E.
- Risk of Disclosure, Perceptions of Risk, and Concerns about Privacy and Confidentiality as Factors in...; 2008; Couper, M. P.; Singer, E.; ; Conrad, F. G.; Groves, R. M.
- Experiments in Producing Nonresponse Bias ; 2006; Groves, R. M., Couper, M. P., Presser, S., Singer, E., Tourangeau, R., Piani Acosta, G., Nelson, L.
- Nonresponse Rates and Nonresponse Bias in Household Surveys; 2006; Groves, R. M.
- Mixed mode methods in a world of social isolates, pervasive surveillance, and ubiquitous transaction...; 2005; Groves, R. M.
- Survey Errors and Survey Costs (Wiley Series in Survey Methodology); 2004; Groves, R. M.
- Survey Methodology (Wiley Series in Survey Methodology); 2004; Groves, R. M., Fowler, F. J., Couper, M. P., Lepkowski, J. M., Singer, E., Tourangeau, R.
- An Experimental Comparison of Three Modes of Data Collection Within the Eurobarometer Measurement Domain...; 2004; Peytcheva, E., Groves, R. M., Manchin, R., Tortora, R. D.
- Comparing Face to Face, Telephone, Paper Self-Administered, and Web Survey Measurement; 2004; Tortora, R. D., Groves, R. M., Peytcheva, E., Manchin, R.
- Survey Automation: Report and Workshop Proceedings; 2003; Cohen, M. L., Groves, R. M., Kalsbeek, W., Cork, D. L.
- Telephone Survey Methodology; 2001; Groves, R. M., Biemer, P. P., Lyberg, L. E., Massey, J. T., Nicholls II, W. L., Waksberg, J.
- Survey Nonresponse; 2001; Groves, R. M., Dillman, D. A., Eltinge, J. L., A.
- Leverage-saliency theory of survey participation; 2000; Groves, R. M., Singer, E., Corning, A.
- Interviewer Reactions to Alternative Hardware for Computer-Assisted Personal Interviewing; 1992; Couper, M. P., Groves, R. M.
- Survey Errors and Survey Costs; 1989; Groves, R. M.
- Methodological Issues in CAPI; 1989; Couper, M. P., Groves, R. M.
- The Status of Computer-Assisted Telephone Interviewing: Part II. Data Quality Issues; 1986; Groves, R. M., Nicholls II, W. L.
- The Status of Computer-Assisted Telephone Interviewing: Part I - Introduction and Impact on Cost and...; 1986; Nicholls II, W. L., Groves, R. M.
- Implications of CATI: Costs, Errors, and Organization of Telephone Survey Research; 1983; Groves, R. M.
- Surveys by telephone: a national comparison with personal interviews; 1979; Groves, R. M., Kahn, R. L.