Web Survey Bibliography
(a) Relevance & Research Question
Online surveys are fast, efficient, and especially cheap. Self-administered surveys might even produce higher data quality compared to personal or phone interviews, e.g. for lower social desirability bias. However, web surveys also face specific problems such as the absence of a human interviewer. Among other things, this limits interview supervision, possibly causing higher item nonresponse and increasing satisficing behavior.
Generally, survey results largely differ depending on collection mode. For instance, recency effects are more likely in oral interviews, which also tend to produce more extreme answers and acquiescence bias, while primacy effects are associated with visual questionnaire presentation. Furthermore, mixed-mode surveys have received growing attention. Since mode effects are of particular relevance there, we will also cover this aspect.
Against this background, analyzing mode effects between traditional modes and web surveys, we show to what extent the latter can be a suitable alternative.
(b) Methods & Data
In the first step, data from three different GLES components are compared, including face-to-face, CATI, and online surveys.
In the second step, we use data from GLES long-term panel. As the second panel wave was collected in a mixed-mode design combining CATI with mail interviews, we compare changes for the sub-samples relative to the first (face-to-face) panel wave.
In terms of methods, we primarily rely on univariate statistics (frequencies, distributions, mean values, variance). We focus on well-established items measuring electoral choice, political attitudes, and psychological predispositions. Beyond, we estimate multivariate models, including interaction terms with survey mode.
Preliminary results uncover a number of clear mode effects between personal, phone, and web surveys. These differences are anything but uniform, though. Rather, we observe differences for specific variables and under specific conditions only.
(d) Added Value
Never before in German electoral science has a similarly coherent questionnaire been implemented in three different survey modes during the same field period. GLES data therefore allow for detailed and unprecedented analyses of mode effects, including mixed-mode surveys. Our results add to the understanding of differences between personal, phone, and web surveys, and suggest what can be done to prevent those differences.
Conference Homepage (abstract) / (full text)
Web Survey Bibliography - Other CASIC (544)
- A report on the Confirmit Market Research Software Survey 2013; 2013; Macer, T., Wilson, S.
- Mode effect analysis and adjustment in a split-sample mixed-mode Web/CATI survey; 2013; Kolenikov, S., Kennedy, C.
- Evaluating the left‐right dimension: Category Selection Probing conducted in an online access...; 2013; Huefken , V.
- Methodological, legal and technical perspectives on the feasibility of web survey paradata in German...; 2013; Sattelberger, S.
- Impact of mode design on reliability in longitudinal data; 2013; Cernat, A.
- Exploring patterns of academic usage: A Google Scholar based study of ESS, EVS, WVS and ISSP academic...; 2013; Malnar, B.
- Web questionnaires in official population surveys: Do's and don'ts First experiments and impacts...; 2013; Blanke, K.
- Mode effects in Labour Force Surveys - do they really matter?; 2013; Koerner, T.
- Measuring the same concepts in several modes in the "BIBB/BAuA-Employee-Survey 2011/12" ; 2013; Gensicke, M., Tschersich, N., Hartmann, J.
- What works? Getting the General Population To Go Online in a Mixed Mode Local Health Survey; 2013; Frigault, L.-R., Azzou, S. A. K., Molloy, E. J. K., Ammarguellat, F., Couture, M., Gratton, J.
- Using Technology to Conduct Questionnaire Evaluations with Hard to Reach Populations ; 2013; Ridolfo, H., Ott, K.
- Mode Effects in a National Establishment Survey; 2013; Daley, K., Phillips, B. T.
- Demonstration of an Integrated Respondent Management and Data Collection Tool for Mixed-Mode (Phone/...; 2013; Luxenberg, H., Rainey, J.
- Evaluating the Effect of a Non-Monetary Incentive in a Nationally Representative Mixed-Mode Establishment...; 2013; Sengupta, M., Harris-Kojetin, L., Hobbs, M., Greene, A.
- Survey Reminder Method Experiment: An Examination of Cost Efficiency and Reminder Mode Salience in the...; 2013; Anderson, M., Rogers, B., CyBulski, K., Hall, J. W., Alderks, C. E., Milazzo-Sayre, L.
- Experiences from a probability-based Internet panel: Sample, recruitment and participation; 2013; Scherpenzeel, A.
- Using paradata to explore item-level response times in surveys; 2012; Couper, M. P., Kreuter, F.
- Specialized Tools for Measuring Past Events ; 2012; Belli, R. F.
- Modes of Data Collection; 2012; Tourangeau, R.
- Mode and non-response effects and their treatment; 2012; Chrysanthopoulos, S., Georgostathi, A.
- The World's Simplest Survey Microsimulator (WSSM); 2012; Karr, A. F., Cox, L. H.
- Latent class analysis of response inconsistencies across modes of data collection; 2012; Yan, T., Kreuter, F., Tourangeau, R.
- “I think I know what you did last summer” Improving data quality in panel surveys; 2012; Lugtig, P. J.
- A report on the Confirmit Market Research Software Survey ; 2012; Macer, T., Wilson, S.
- Assessing the Mode-dependency of Survey Response and Non-response Bias; 2012; Klausch, L. T., Hox, J., Schouten, B.
- Using Text-to-Speech (TTS) for Audio-CASI; 2012; Couper, M. P., Kirgis, N., Buageila, S., Berglund, P.
- Cell Sample Demographics under Alternative Dual-Frame Sample Designs; 2012; Montgomery, R., Morrison, H., Zeng, W., Wolter, K., Blumberg, S. J., O'Connor, K.
- Disentangling Mode and Nonresponse Effects in the World Trade Center Health Registry; 2012; Murphy, J., Brackbill, R., Yu, S., Wu, D., Walker, D., Turner, L., Stellman, S., Miller, S., Saleska...
- Does Mode Matter? Initial Evidence from the German Longitudinal Election Study (GLES); 2012; Blumenstiel, J. E., Rossmann, J.
- The Representativity of Web Surveys of the General Population compared to Traditional Modes and Mixed...; 2012; Klausch, L. T., Schouten, B., Hox, J.
- Proposed Indicators to Assess Interviewer Performance (IP) in CATI Surveys; 2011; Laflamme, F.
- Web based CATI on Amazon Elastic Compute Cloud and VirtualBox using queXS; 2011; Zammit, A.
- Web/Cloud Based CATI Using queXS; 2011; Zammit, A.
- When Referring to Mode, Is Expressed Preference the Same as Reality?; 2011; Denk, K.
- Three Era's of Survey Research; 2011; Groves, R. M.
- Testing a single mode vs a mixed mode design; 2011; Laaksonen, S.
- The role of visual and aural stimuli in producing mode effects on answers to survey questions; 2011; Lynn, P., Hope, S., Campanelli, P., Nandi, A., Nicolaas, G., Jaeckle, A.
- Causes of Mode Effects on Survey Measurement ; 2011; Lynn, P., Campanelli, P., Nicolaas, G., Hope, S., Nandi, A., Jaeckle, A.
- Separating selection from mode effects when switching from single (CATI) to mixed mode design (CATI /...; 2011; Carstensen, J., Kriwy, P., Krug, G., Lange, C.
- Testing between-mode measurement invariance under controlled selectivity conditions; 2011; Klausch, L. T.
- A Comparison of CAPI and PAPI through a Randomized Field Experiment; 2011; De Weerdt, J.
- Changing research methods in Ukraine: CATI or Mixed-Mode Surveys?; 2011; Paniotto, V., Kharchenko, N.
- Drop-out rates during completion of an occupation search tree in web-surveys; 2011; Tijdens, K.
- Completing Web Surveys on Cell-enabled iPads.; 2011; Dayton, J., Driscoll, H.
- Use these five Web-based approaches to shrink your research timelines, costs ; 2011; Cutler, A. D.
- The impact of next and back buttons on time to complete and measurement reliability in computer-based...; 2010; Hays, R. D. et al.
- Lessons from a Randomised Experiment with Mixed-Mode Designs for a Household Panel Survey; 2010; Lynn, P., Uhrig, S.C. N., Burton, J.
- Statistics Canada's Process Automation of On-line Survey Development and CATI Data Integration; 2010; Dubois, M.-A.
- Operational Aspects of Recruiting High Internet Users via a CATI Screening on an RDD Frame; 2010; Batra, P.
- Uses of YouTube, and Other Web 2.0 Applications, in Data Collection; 2010; Franklin, J.