Web Survey Bibliography
Survey researchers, who must choose between mixed mode and single mode surveys, currently have limited evidence regarding implications for measurement and estimation. While many studies have investigated measurement effects associated with the main survey modes, and the overall effect of conducting a survey in one mode rather than another, few studies assess the overall effect of a mixed mode design versus a single mode.
Yet the question of equivalence between single and multi-mode surveys is important in many practical situations. In cross-national surveys, for example, only some countries may have the capacity to carry out a mixed-mode survey. In this paper, we discuss the evidence survey researchers need to help them to decide whether a mixed mode survey can provide data equivalent to a single mode survey, and we offer some tentative conclusions based on a case study.
We present an experiment conducted in the Netherlands parallel to Round 4 of the European Social Survey (ESS4). Two different mixed-mode designs – “concurrent” and “sequential”, both involving web, telephone, and face-to-face interviews – were compared with the regular single-mode ESS4 survey. We discuss practical difficulties encountered in the design and management of the mixed mode surveys, and offer explanations for the surprising finding that both mixed mode designs achieved a significantly lower response rate than the single-mode face-to-face survey.
We also gauge the equivalence of univariate and multivariate analyses across the three designs. While most variables yield equivalent point estimates across all three samples, there are notable and statistically significant differences on some types of variables, especially those with social desirability connotations. We also explore the more complex effects that the mixed mode designs had on patterns of bivariate correlations, and on the results of multivariate analyses.
Conference Homepage (abstract)
Web Survey Bibliography (6376)
- Developments and the impact of smart technology; 2012; Macer, T.
- How Should Debriefing Be Undertaken in Web-Based Studies? Findings From a Randomized Controlled Trial...; 2012; McCambridge, J., Kypri, K., Wilson, A.
- Better customer in sight in real time; 2012; Macdonald, E., Wilson, H. N., Konus, H.
- Best practices in data cleaning: A complete guide to everything you need to do before and after collecting...; 2012; Osborne, J. W.
- Benchmarking for better surveys; 2012; Nallan, S.
- An experimental investigation of the effects of noncontingent and contingent incentives in recruiting...; 2012; Lavrakas, P. J., Dennis, J. M., Peugh, J., Shand-Lubbers, J., Lee, E., Peugh, J., Charlebois, O., Murakami...
- Adult gadget ownership over time (2006-2012); 2012
- Subjective Well-being Of Spanish Workers: Continuous Voluntary Web Survey Examination; 2012; de Pedraza, P., Guzi, M.
- 28 Questions to Help Buyers of Online Samples; 2012
- 2010 ACS Content Test Evaluation Report Covering Computer and Internet ; 2012; Shin, H. B.
- Specific mixed-mode methodology to reach sensory disabled people in quantitative surveys; 2012; Fontaine, S.
- Response Mode Choice and the Hard-to-Interview in the American Community Survey; 2012; Nichols, E. M., Horwitz, R., Guarino Tancreto, J.
- Recruiting in an Internet panel using respondent driven sampling; 2012; Schonlau, M.
- A Choice in Mode: A Solution for Increasing Response Rates of Hard-to-Survey Populations?; 2012; Haan, M., Ongena, Y. P.
- The Feasibility of Conducting a Web Survey Using Respondent Driven Sampling among Transgenders in the...; 2012; Kappelhof, J.
- The role of topic interest and topic salience in online panel web surveys.; 2012; Keusch, F.
- Multi-Language Multi-Continent B2B Community Panel: How B2B research can effectively span the world; 2012; Morden, M., Accomando, E.
- Can Survey Gaming Techniques Cross Continents? Examining cross cultural reactions to creative questioning...; 2012; Puleston, J.
- Facing The Future Webcams as a survey tool in China; 2012; Gordon, A., Llewellyn, T., Gu, E.
- Device Diversity: Understanding the complexity of varied devices for taking surveys – Case study...; 2012; Pearson, C., Backlund, K., Veling, L., Tsvelik, M., Jehoel, S.
- Research Goes Mobile: Findings from initial smartphone application research; 2012; Dubreuil, C., Joubert, S.
- Research in the Mobile Mindset: Exploring the unexplored in the mobile research space; 2012; Willems, A., Veris, E., Verhaeghe, A.
- Better Answers to Basic Questions: Enhancing the accuracy of online reach and audience metrics; 2012; van Dam, P. H., van Ossenbruggen, R., Voorend, R.
- Rules of engagement: The war against poorly engaged respondents - guidelines for elimination; 2012; Gittelman, S. H., Trimarchi, E.
- Reality check in the digital age: The relationship between what we ask and what people actually do; 2012; Hofmeyr, J., Louw, A.
- Website Versus Traditional Survey Comments: Do they tell the same story?; 2012; Brandt, R., House, M.
- Dimensions of Online Survey Data Quality What really matters?; 2012; Puleston, J., Eggers, M.
- WEBDATANET: web-based data-collection methodological challenges, solutions and implementations. Action...; 2012; de Pedraza, P.
- WebSM Study: Survey software features overview ; 2012; Vehovar, V.; Cehovin, G.; Kavcic, L.; Lenar, J.
- Web Panels; 2012; Bethlehem, J., Biffignandi, S.
- Use of Response Propensities; 2012; Bethlehem, J., Biffignandi, S.
- Weighting Adjustment Techniques; 2012; Bethlehem, J., Biffignandi, S.
- The Problem of Self-Selection; 2012; Bethlehem, J.,Biffignandi, S.
- The Problem of Undercoverage; 2012; Bethlehem, J., Biffignandi, S.
- Mixed-Mode Surveys; 2012; Bethlehem, J., Biffignandi, S.
- Designing a Web Survey Questionnaire; 2012; Bethlehem, J., Biffignandi, S.
- Examining Contexts-of-Use for Web-Based and Paper-Based Questionnaires; 2012; Hardré, P. L., Crowson, H. M., Xie, K.
- Probabilistic survey questions and incorrect answers: Retirement income replacement rates; 2012; van Santen, P., Alessie, R., Kalwij, A.
- Survey Quality; 2012; Lyberg, L. E.
- Combining Mail and E-Mail Contacts to Facilitate Participation in Mixed-Mode Surveys; 2012; Israel, G. D.
- Effects of E-Mailed Versus Mailed Invitations and Incentives on Response Rates, Data Quality, and Costs...; 2012; Dykema, J., Stevenson, J., Klein, L., Kim, Y., Day, B.
- Prenotification, Incentives, and Survey Modality: An Experimental Test of Methods to Increase Survey...; 2012; Tepper, J. R., Jacob, B.
- Measuring Work Activities and Skill Requirements of Occupations: Experiences from a European Pilot Study...; 2012; Tijdens, K., De Ruijter, E., De Ruijter, J.
- Using Free Online Survey Software in Your Teaching; 2012; Chippindall, J.
- Reaching and Hearing the Invisible: Organizational Research on Invisible Stigmatized Groups via Web...; 2012; Trau, R. N. C., Haertel, C. E. J., Haertel, G. F.
- Comparability of Survey Measurements; 2012; Oberski, D.
- Why People Agree to Participate in Surveys; 2012; Albaum, G., Smith, S. M.
- Unit Non-Response Due to Refusal; 2012; Stoop, I.
- Classification of Surveys; 2012; Stoop, I., Harrison, E.
- What Survey Modes are Most Effective in Eliciting Self-Reports of Criminal or Delinquent Behavior?; 2012; Kleck, G., Roberts, K.