Web Survey Bibliography
(a) Relevance & Research Question
Online surveys are fast, efficient, and especially cheap. Self-administered surveys might even produce higher data quality compared to personal or phone interviews, e.g. for lower social desirability bias. However, web surveys also face specific problems such as the absence of a human interviewer. Among other things, this limits interview supervision, possibly causing higher item nonresponse and increasing satisficing behavior.
Generally, survey results largely differ depending on collection mode. For instance, recency effects are more likely in oral interviews, which also tend to produce more extreme answers and acquiescence bias, while primacy effects are associated with visual questionnaire presentation. Furthermore, mixed-mode surveys have received growing attention. Since mode effects are of particular relevance there, we will also cover this aspect.
Against this background, analyzing mode effects between traditional modes and web surveys, we show to what extent the latter can be a suitable alternative.
(b) Methods & Data
In the first step, data from three different GLES components are compared, including face-to-face, CATI, and online surveys.
In the second step, we use data from GLES long-term panel. As the second panel wave was collected in a mixed-mode design combining CATI with mail interviews, we compare changes for the sub-samples relative to the first (face-to-face) panel wave.
In terms of methods, we primarily rely on univariate statistics (frequencies, distributions, mean values, variance). We focus on well-established items measuring electoral choice, political attitudes, and psychological predispositions. Beyond, we estimate multivariate models, including interaction terms with survey mode.
Preliminary results uncover a number of clear mode effects between personal, phone, and web surveys. These differences are anything but uniform, though. Rather, we observe differences for specific variables and under specific conditions only.
(d) Added Value
Never before in German electoral science has a similarly coherent questionnaire been implemented in three different survey modes during the same field period. GLES data therefore allow for detailed and unprecedented analyses of mode effects, including mixed-mode surveys. Our results add to the understanding of differences between personal, phone, and web surveys, and suggest what can be done to prevent those differences.
Conference Homepage (abstract) / (full text)
Web Survey Bibliography - Other CASIC (529)
- Experiences from a probability-based Internet panel: Sample, recruitment and participation; 2013; Scherpenzeel, A.
- Using paradata to explore item-level response times in surveys; 2012; Couper, M. P., Kreuter, F.
- Specialized Tools for Measuring Past Events ; 2012; Belli, R. F.
- Modes of Data Collection; 2012; Tourangeau, R.
- Mode and non-response effects and their treatment; 2012; Chrysanthopoulos, S., Georgostathi, A.
- The World's Simplest Survey Microsimulator (WSSM); 2012; Karr, A. F., Cox, L. H.
- Latent class analysis of response inconsistencies across modes of data collection; 2012; Yan, T., Kreuter, F., Tourangeau, R.
- “I think I know what you did last summer” Improving data quality in panel surveys; 2012; Lugtig, P. J.
- A report on the Confirmit Market Research Software Survey ; 2012; Macer, T., Wilson, S.Wilson, Sheila
- Assessing the Mode-dependency of Survey Response and Non-response Bias; 2012; Klausch, L. T., Hox, J., Schouten, B.
- Using Text-to-Speech (TTS) for Audio-CASI; 2012; Couper, M. P., Kirgis, N., Buageila, S., Berglund, P.
- Cell Sample Demographics under Alternative Dual-Frame Sample Designs; 2012; Montgomery, R., Morrison, H., Zeng, W., Wolter, K., Blumberg, S. J., O'Connor, K.
- Disentangling Mode and Nonresponse Effects in the World Trade Center Health Registry; 2012; Murphy, J., Brackbill, R., Yu, S., Wu, D., Walker, D., Turner, L., Stellman, S., Miller, S., Saleska...
- Does Mode Matter? Initial Evidence from the German Longitudinal Election Study (GLES); 2012; Blumenstiel, J. E., Rossmann, J.
- The Representativity of Web Surveys of the General Population compared to Traditional Modes and Mixed...; 2012; Klausch, L. T., Schouten, B., Hox, J.
- Proposed Indicators to Assess Interviewer Performance (IP) in CATI Surveys; 2011; Laflamme, F.
- Web based CATI on Amazon Elastic Compute Cloud and VirtualBox using queXS; 2011; Zammit, A.
- Web/Cloud Based CATI Using queXS; 2011; Zammit, A.
- When Referring to Mode, Is Expressed Preference the Same as Reality?; 2011; Denk, K.
- Three Era's of Survey Research; 2011; Groves, R. M.
- Testing a single mode vs a mixed mode design; 2011; Laaksonen, S.
- The role of visual and aural stimuli in producing mode effects on answers to survey questions; 2011; Lynn, P., Hope, S., Campanelli, P., Nandi, A., Nicolaas, G., Jaeckle, A.
- Causes of Mode Effects on Survey Measurement ; 2011; Lynn, P., Campanelli, P., Nicolaas, G., Hope, S., Nandi, A., Jaeckle, A.
- Separating selection from mode effects when switching from single (CATI) to mixed mode design (CATI /...; 2011; Carstensen, J., Kriwy, P., Krug, G., Lange, C.
- Testing between-mode measurement invariance under controlled selectivity conditions; 2011; Klausch, L. T.
- A Comparison of CAPI and PAPI through a Randomized Field Experiment; 2011; De Weerdt, J.
- Changing research methods in Ukraine: CATI or Mixed-Mode Surveys?; 2011; Paniotto, V., Kharchenko, N.
- Drop-out rates during completion of an occupation search tree in web-surveys; 2011; Tijdens, K.
- Completing Web Surveys on Cell-enabled iPads.; 2011; Dayton, J., Driscoll, H.
- Use these five Web-based approaches to shrink your research timelines, costs ; 2011; Cutler, A. D.
- Comparing the Accuracy of RDD Telephone Surveys and Internet Surveys Conducted with Probability and...; 2011; Yeager, D. S., Krosnick, J. A., Chang, L. C., Javitz, H. S., Levindusky, M. S., Simpser, A.; Wang, R...
- The impact of next and back buttons on time to complete and measurement reliability in computer-based...; 2010; Gershon, R. C. et al.
- Lessons from a Randomised Experiment with Mixed-Mode Designs for a Household Panel Survey; 2010; Lynn, P., Uhrig, S.C. N., Burton, J.
- Statistics Canada's Process Automation of On-line Survey Development and CATI Data Integration; 2010; Dubois, M.-A.
- Operational Aspects of Recruiting High Internet Users via a CATI Screening on an RDD Frame; 2010; Batra, P.
- Uses of YouTube, and Other Web 2.0 Applications, in Data Collection; 2010; Franklin, J.
- Long-Term Efficacy of Sequential Mixed-Mode Designs on Response Rates and Cost in a Panel Survey; 2010; Levenstein, R. M., Barber, J. S., Gatny, H. H.
- Completing Web Surveys on Smart Phones; 2010; Dayton, J. J., Freedner, N., Hannah, K.
- Statistical foundations of cell-phone surveys; 2010; Wolter, K., Smith, P., Blumberg, S. J.
- Self-administered mobile surveys: Usability and (non)participation; 2010; Scherrer, S., Bosnjak, M.
- The impact of incentives and interview methods on response quantity and quality in diary- and booklet...; 2010; Bonke, J., Fallesen, P.
- Computer Literacy and the Accuracy of Substance Use Reporting in an ACASI Survey; 2010; Johnson, T. P., Fendrich, M., Mackesy-Amiti, M. E.
- A report on the 2009 Globalpark Market Research Software Survey; 2010; Macer, T., Wilson, S.
- Web-based versus paper-based data collection for the evaluation of teaching activity: empirical evidence...; 2010; Lalla, M., Ferrari, D.
- Understanding the Willingness to Participate in Mobile Surveys: Exploring the Role of Utilitarian, Affective...; 2010; Bosnjak, M., Metzger, G., Graef, L.
- Mode and Context Effects in Measuring Household Assets; 2010; van Soest, A., Kapteyn, A.
- Improving the response rate and quality in Web-based surveys through the personalization and frequency...; 2010; Muñoz-Leiva, F., Sánchez-Fernández, J., Montoro-Ríos, F. J., Ibáñez-Zapata, J. A.
- College Experiences Survey: Methodological Summary. Final Report; 2009; DesRoches, D., Hall, J. W., Santos, B.
- Cell Phone Mainly Households: Coverage and Reach for Telephone Surveys Using RDD Landline Samples; 2009; Boyle, J., Lewis, F., Tefft, B.
- Cell-Phone-Only Voters in the 2008 Exit Poll and Implications for Future Noncoverage Bias ; 2009; Mokrzycki, M., Keeter, S., Kennedy, C.