Web Survey Bibliography
Title Telephone versus Face-to-Face Interviewing: Mode Effects on Data Quality and Likely Causes. Report on Phase II of the ESS-Gallup Mixed Mode Methodology Project
Author Jaeckle, A., Lynn, P., Roberts, C.,
Source ISER Working Paper Series
Year 2006
Access date 22.04.2014
Full text
Abstract
This report presents findings from an experimental study carried out in the context of the European Social Survey, to assess the impact a change in data collection mode from the current face-to-face interviewing to telephone might have on data quality and to study the likely causes of any observed mode effects. Evidence from previous studies suggests which differences in response can be expected between telephone and face-to-face interviewing and also suggests likely causes of such differences. Previous empirical studies are, however, often limited in their ability to isolate different causes. The experimental design enabled us to distinguish mode effects caused by differences in the type of question stimulus used in each mode (audio vs. visual) and mode effects caused by the presence or absence of the interviewer. The design included three comparison groups (two interviewed face-to-face (one with showcards, one without) and the third by telephone). We found evidence of effects caused by the presence of the interviewer, but few stimulus effects. We tested a number of hypotheses about the likely causes of mode effects on response, focusing on three forms of satisficing and social desirability bias. We found no evidence that using showcards influenced response quality, either positively or negatively. Unlike previous studies, we found no support for the hypothesis that telephone respondents were more likely to satisfice. However, consistent with our expectations, we did find telephone respondents were more likely to give socially desirable responses across a range of indicators.
Access/Direct link
Homepage (abstract) / (full text)
Year of publication2006
Bibliographic typeReports, seminars
Web survey bibliography - Lynn, P. (35)
- Targeted Appeals for Participation in Letters to Panel Survey Members; 2016; Lynn, P.
- Assessing targeted approach letters: effects in different modes on response rates, response speed and...; 2016; Lynn, P.
- Revisiting “yes/no” versus “check all that apply”: Results from a mixed modes...; 2016; Nicolaas, G.; Campanelli, P.; Hope, S.; Jaeckle, A.; Lynn, P.
- Understanding Society Innovation Panel Wave 7: Results from Methodological Experiments; 2015; Blom, A. G.; Burton, J.; Booker, C. L.; Cernat, A.; Fairbrother, M.; Jaeckle, A.; Kaminska, O.; Keusch...
- Going Online with a Face-to-Face Household Panel: Effects of a Mixed Mode Design on Item and Unit Non...; 2015; Burton, J.; Jaeckle, A.; Lynn, P.
- The role of email addresses and email contact in encouraging web response in a mixed mode design ; 2014; Cernat, A., Lynn, P.
- Measurement effects between CAPI and Web questionnaires in the UK Household Longitudinal Study; 2014; Lynn, P., Vannieuwenhuyze, J. T. A.
- Improving Survey Methods: Lessons from Recent Research; 2014; Engel, U., Jann, B., Lynn, P., Scherpenzeel, A., Sturgis, P.
- Tailoring mode of data collection in longitudinal studies; 2013; Kaminska, O., Lynn, P.
- Understanding Society Innovation Panel Wave 5: results from methodological experiments; 2013; Auspurg, K., Burton, J., Cullinane, C., Delavande, A., Fumagalli, L., Iacovou, M., Jaeckle, A., Kaminska...
- The Role of Mode Preference Questions in Predicting Mode-Specific Response Propensities; 2013; Lynn, P., Kaminska, O.
- Issues of Coverage and Sampling in Web Surveys for the General Population; 2013; Lynn, P.
- Going online with a face-to-face household panel: initial results from an experiment on the Understanding...; 2013; Jaeckle, A., Lynn, P., Burton, J.
- Targeted response inducement strategies on longitudinal surveys; 2013; Lynn, P.
- An Initial Look at Non-Response and Attrition in Understanding Society; 2012; Lynn, P., Burton, J., Kaminska, O., Knies, G., Nandi, A.
- The Propensity of Older Respondents to Participate in a General Purpose Survey; 2012; Lynn, P.
- Mode-Switch Protocols: How a Seemingly Small Design Difference can affect Attrition Rates and Attrition...; 2012; Lynn, P.
- Going online with a face-to-face household panel: Initial results from an experiment on the UK Household...; 2012; Jaeckle, A., Lynn, P., Burton, J.
- ISER working paper 2011-31. Is it a good idea to optimise question format for mode of data collection...; 2011; Nicolaas, G., Campanelli, P., Hope, S., Jaeckle, A., Lynn, P.
- Maintaining Cross-Sectional Representativeness in a Longitudinal General Population Survey ; 2011; Lynn, P.
- The Effect of a Mixed Mode Wave on Subsequent Attrition in a Panel Survey: Evidence from the Understanding...; 2011; Lynn, P.
- Is it a good idea to optimise question format for mode of data collection? Results from a mixed modes...; 2011; Nicolaas, G., Campanelli, P., Hope, S., Lynn, P., Nandi, A.
- The effects of mixed mode designs on simple and complex analyses; 2011; Martin, P., Lynn, P.
- Making Good Use of Survey Paradata; 2010; Lynn, P., Nicolaas, G.
- Weighting Strategy for Understanding Society; 2010; Lynn, P., Kaminska, O.
- Sample Design for Understanding Society ; 2009; Lynn, P.
- Methodological Research for Longitudinal Surveys; 2009; Lynn, P.
- Mixed Modes and Measurement Error: Comparing face-to-face, telephone and web modes ; 2009; Hope, S., Nicolaas, G., Jaeckle, A., Lynn, P., Nandi, A., Campanelli, P.
- New Methodologies in Sampling Rare and Elusive Populations; 2009; Pal, S., Thompson, S., Kalton, G., Lynn, P.
- Respondent Incentives in a Multi-Mode Panel Survey: Cumulative Effects on Non-Response and Bias; 2008; Jaeckle, A., Lynn, P.
- Methodology in Our Madness; 2007; Lynn, P.
- Using Multiple Modes to Collect Data in Surveys; 2007; Lynn, P.
- Telephone versus Face-to-Face Interviewing: Mode Effects on Data Quality and Likely Causes. Report...; 2006; Jaeckle, A., Lynn, P., Roberts, C.,
- Towards Standardisation of Survey Outcome Categories and Response Rate Calculations; 2003; Lynn, P., Beerten, R., Laiho, J., Martin, J.
- Recommended Standard Final Outcome Categories and Standard Definitions of Response Rate for Social Surveys...; 2001; Lynn, P., Beerten, R., Laiho, J., Martin, J.