Web Survey Bibliography
Relevance & Research Question: Web surveys of the general population are suspected to yield less representative samples than traditional survey modes for two major reasons. First, population coverage with internet access is incomplete in most countries. Second, response rates to Web surveys are generally lower than in traditional modes. Sequential mixed-mode strategies using personal (CAPI) or telephone (CATI) interviews have been suggested to cope with the presumed representativity problem. In this study we assess the underlying assumptions of this reasoning, i.e., first, whether a probability sample using Web for data collection is less representative than other modes and, second, whether CAPI or CATI possess properties that can compensate for bias when added in sequence to Web.
Methods & Data: We conducted an experiment based on a national probability sample of 8,800 persons in the context of the Dutch ‘Security Monitor’ survey. Persons were assigned to one out of four modes (Web, Mail, CATI, CAPI). Mailed invitations contained a link (Web), a questionnaire (Mail), or announced the contact by an interviewer (CAPI/CATI). After 4-8 weeks we approached every person again in a second wave, either by CAPI or CATI. We included questions on internet coverage in this wave. To assess representativity, background data was available from national registries.
Results: Though The Netherlands are a country of high internet coverage, the impact of under-coverage on representativity was strong (assessed by R-indicators). However, many of the coverage deficits were mitigated in the process of contact and cooperation. The final Web response sample was as representative as CAPI and even more representative than CATI and Mail. Mixing modes in sequence (i.e. Web followed by CAPI or CAPI+CATI) was not capable of compensating the deficits of Web beyond well-known net increases in response rates.
Added Value: Our results question two basic assumptions about Web surveys and mixed-mode designs. We suggest that Web surveys possess equally good or better response properties as traditional modes, if they are based on probability samples and population coverage with internet access is high. Also, from a representativity perspective, we did not find evidence in favour of using mixed-mode designs.
Conference Homepage (abstract) / (full text)
Web Survey Bibliography - Mode comparisons (1494)
- How Representative are Google Consumer Surveys?: Results From an Analysis of a Google Consumer Survey...; 2013; Krishnamurty, P., Tanenbaum, E., Stern, M. J.
- One Drink or Two: Does Quantity Depicted in an Image Affect Web Survey Responses?; 2013; Charoenruk, N., Stange, M.
- A Comparison Between Screen/Follow Item Format and Yes/No Item Format on a Multi-Mode Federal Survey; 2013; Hernandez,S. J., Arakelyan, S. N., Welch, V. E.
- Using Multiple Modes in Follow-Up Contacts in Random-Digit Dialing Surveys; 2013; Chowdhury, P. P.
- Tablets and Smartphones and Netbooks, Oh My! Effects of Device Type on Respondent Behavior; 2013; Ross, H., Mendelson, J., Lackey, M.
- Multi-Mode Survey Administration: Does Offering Multiple Modes at Once Depress Response Rates?; 2013; Newsome, J., Levin, K., Langetieg, P., Vigil, M., Sebastiani, M.
- Utilizing the Web in a Multi-Mode Survey; 2013; Venkataraman, L.
- Mode Matters: Evaluating Response Comparability in a Mixed-Mode Survey; 2013; Bowyer, B. T., Rogowski, J. C.
- Comparing Survey Results Obtained via Mobile Devices and Computers: An Experiment With a Mobile Web...; 2013; de Bruijne, M., Wijnant, A.
- PDAs in socio-economic surveys: instrument bias, surveyor bias or both?; 2013; Escobal, J., Benites, S.
- Compared to a small, supervised lab experiment, a large, unsupervised web-based experiment on a previously...; 2013; Ryan, R. S., Wilde, M., Crist, S.
- From mixed-mode to multiple devices. Web surveys, smartphone surveys and apps: has the respondent gone...; 2013; Callegaro, M.
- Moving an established survey online – or not?; 2013; Barber, T., Chilvers, D., Kaul, S.
- Managing mobile research: How it's different and why it matters; 2013; Kachhi-Jiwani, D., Tucker, J., Wilding-Brown, L.
- Cyborgs vs. Monsters: Assembling Modular Surveys to Create Complete Datasets; 2013; Johnson, E. P., Siluk, L., Tarraf, S.
- A standard for test reliability in group research; 2013; Ellis, J. L.
- The comparison of road safety survey answers between web-panel and face-to-face; Dutch results of SARTRE...; 2013; Goldenbeld, C., de Craen, S.
- Addressing Survey Nonresponse Issues: Implications for ATE Principal Investigators, Evaluators, and...; 2013; Welch, W. W., Barlau, A. N.
- Consolidation and Standardization of Survey Operations at a Decentralized Federal Statistical Agency; 2013; Nealon, J., Gleaton, E.
- Examination of the equivalence of self-report survey-based paper-and-pencil and internet data collection...; 2013; Weigold, A., Weigold, I. K., Russell, E. J.
- Online Mixed Mode Surveying using a Responsive Design; 2013; Kissau, K.
- Sensitive Topics in PC and Mobile Web Surveys; 2013; Mavletova, A. M., Couper, M. P.
- Mobile Research Performance: How Mobile Respondents Differ from PC Users Concerning Interview Quality...; 2013; Schmidt, S., Wenzel, O.
- Comparison of psychometric properties of internet versions of the Marlowe-Crowne Social Desirability...; 2013; Vesteinsdottir, V., Reips, U. -D., Joinson, A. N., Porsdottir, F.
- Research Design as an Influencing Factor for Reliability in Online Market Research; 2013; Wengrzik, J., Theuner, G.
- Rewards - Money for Nothing?; 2013; Cape, P. J., Martin, P.
- Using Web Survey Panels to Estimate Population Characteristics: A Comparison of Alternative Approaches...; 2013; Rivers, D.
- Issues of Coverage and Sampling in Web Surveys for the General Population: An Overview; 2013; Lynn, P.
- Comparison of web-based versus paper-and-pencil administration of a humor survey; 2013; Wang, C.-C., Cheng, C.-L.;, Liu, K.-S., Cheng, Y.-Y.
- Virtual Research Methods; 2013; Hine, C.
- Measurement invariance and quality of composite scores in a face-to-face and a web survey; 2013; Revilla, M.
- Exploring Response Differences between Face-to-Face and Web Surveys: A Qualitative Comparative Analysis...; 2013; Bennink, M., Moors, G., Gelissen, J.
- The Use of Mixed Methods in Organizational Communication Research; 2013; Salem, P. J.
- The Use of E-Questionnaires in Organizational Surveys; 2013; Brender-Ilan, Y., Vinitzky, G.
- The equivalence of Internet versus paper-based surveys in IT/IS adoption research in collectivistic...; 2013; Fang, J., Wen, C., Prybutok, V.
- Mode Effects in Free-list Elicitation: Comparing Oral, Written, and Web-based Data Collection; 2013; Gravlee, C. C., Bernard, H. R., R., Jacobsohn, A., R.Maxwell, C. R.
- A comparison of data quality and practicality of online versus postal questionnaires in a sample of...; 2013; King, M. T., Butow, P., Olver, I., Smith, A. B.
- How Often Do You Use the App with a Bird on It? Exploring Differences in Survey Completion Times, Primacy...; 2012; Buskirk, T. D.
- Specialized Tools for Measuring Past Events ; 2012; Belli, R. F.
- Anonymity and Confidentiality; 2012; Tourangeau, R.
- Modes of Data Collection; 2012; Tourangeau, R.
- Mode and non-response effects and their treatment; 2012; Chrysanthopoulos, S., Georgostathi, A.
- Digital Divides: A connectivity continuum for the United States. Data from the 2011 Current Population...; 2012; File, T.
- Website Versus Traditional Survey Comments: Do they tell the same story?; 2012; Brandt, R., House, M.
- Web Panels; 2012; Bethlehem, J., Biffignandi, S.
- Examining Contexts-of-Use for Web-Based and Paper-Based Questionnaires; 2012; Hardré, P. L., Crowson, H. M., Xie, K.
- Prenotification, Incentives, and Survey Modality: An Experimental Test of Methods to Increase Survey...; 2012; Tepper, J. R., Jacob, B.
- Comparability of Survey Measurements; 2012; Oberski, D.
- Why People Agree to Participate in Surveys; 2012; Albaum, G., Smith, S. M.
- Unit Non-Response Due to Refusal; 2012; Stoop, I.