Web Survey Bibliography
Relevance & Research Question: Web surveys of the general population are suspected to yield less representative samples than traditional survey modes for two major reasons. First, population coverage with internet access is incomplete in most countries. Second, response rates to Web surveys are generally lower than in traditional modes. Sequential mixed-mode strategies using personal (CAPI) or telephone (CATI) interviews have been suggested to cope with the presumed representativity problem. In this study we assess the underlying assumptions of this reasoning, i.e., first, whether a probability sample using Web for data collection is less representative than other modes and, second, whether CAPI or CATI possess properties that can compensate for bias when added in sequence to Web.
Methods & Data: We conducted an experiment based on a national probability sample of 8,800 persons in the context of the Dutch ‘Security Monitor’ survey. Persons were assigned to one out of four modes (Web, Mail, CATI, CAPI). Mailed invitations contained a link (Web), a questionnaire (Mail), or announced the contact by an interviewer (CAPI/CATI). After 4-8 weeks we approached every person again in a second wave, either by CAPI or CATI. We included questions on internet coverage in this wave. To assess representativity, background data was available from national registries.
Results: Though The Netherlands are a country of high internet coverage, the impact of under-coverage on representativity was strong (assessed by R-indicators). However, many of the coverage deficits were mitigated in the process of contact and cooperation. The final Web response sample was as representative as CAPI and even more representative than CATI and Mail. Mixing modes in sequence (i.e. Web followed by CAPI or CAPI+CATI) was not capable of compensating the deficits of Web beyond well-known net increases in response rates.
Added Value: Our results question two basic assumptions about Web surveys and mixed-mode designs. We suggest that Web surveys possess equally good or better response properties as traditional modes, if they are based on probability samples and population coverage with internet access is high. Also, from a representativity perspective, we did not find evidence in favour of using mixed-mode designs.
Conference Homepage (abstract) / (full text)
Web survey bibliography - General Online Research Conference (GOR) 2012 (26)
- Is „chapterisation“ a viable alternative to traditional progress indicators ?; 2012; Spicer, R., Dowling, Z.
- Exploring New Pathways to Survey Recruitment; 2012; Bilgram, V., Stadler, D.Jawecki, G.
- Understanding selection bias in a worldwide, volunteer web-survey; 2012; Tijdens, K., Steinmetz, S.
- Does Mode Matter? Initial Evidence from the German Longitudinal Election Study (GLES); 2012; Blumenstiel, J. E., Rossmann, J.
- The Representativity of Web Surveys of the General Population compared to Traditional Modes and Mixed...; 2012; Klausch, L. T., Schouten, B., Hox, J.
- Surveytainment 2.0: Why investing 10 more minutes more in constructing your questionnaire is worth considering...; 2012; Muehle, A., Tress, F., Schmidt, S., Winkler, T.
- Market research online community (MROC) versus focus group; 2012; Zuber, M.
- Data quality in MAWI and CAWI; 2012; Mavletova, A. M., Blasius, J.
- Time use data collection using Smartphones: Results of a pilot study among experienced and inexperienced...; 2012; Scherpenzeel, A., Sonck, N., Fernee, H., Morren, Me.
- Scrutinizing Dynamics – Rolling panel waves in theory and practice; 2012; Faas, T., Blumenberg, J. N.
- Little experience with technology as a cause of nonresponse in online surveys; 2012; Struminskaya, B., Schaurer, I., Kaczmirek, L., Bandilla, W.
- Automatic Forwarding on Web Surveys – Some Outlines and Remarks; 2012; Selkaelae, A.
- Thinking, Planning & Operationalizing Empirical Mixed Methods Research Design; 2012; Ruhi, U.
- Continuous large-scale volunteer web-surveys: The experience of Lohnspiegel and WageIndicator; 2012; Oez, F.
- Is Pretesting Established Among Online Survey Tool Users?; 2012
- An Evaluation of Two Non-Reactive Web Questionnaire Pretesting Methods; 2012; Lenzner, T.
- Recommendations for implementing online surveys and simple experiments in social and behavioural research...; 2012; Hewson, C. M.
- High potential for mobile Web surveys: Findings from a survey representative for German Internet users...; 2012; Funke, F., Wachenfeld, A.
- A taxonomy of paradata for web surveys and computer assisted self interviewing (Casi); 2012; Callegaro, M.
- Can Social Media Research replace traditional research methods?; 2012; Faber, T., Einhorn, M., Hofmann, O., Loeffler, M.
- Bad Boy Matrix Question – Whatcha gonna do when they come for you?; 2012; Tress, F.
- Matrix vs. Single Question Formats in Web Surveys: Results from a large scale experiment; 2012; Klausch, L. T., de Leeuw, E. D., Hox, J., de Jongh, A., Roberts , A.
- Effects of Static versus Dynamic Formatting Instructions for Open-Ended Numerical Questions in Web Surveys...; 2012; Kunz, T., Fuchs, M.
- FamilyVote – Conducting online surveys with children and families; 2012; Geissler, H., Peeters, H.
- The influence of social desirability on data quality in face-to-face and web surveys; 2012; Keusch, F.
- Reducing the Threat of Sensitive Questions in Online Surveys; 2012; Couper, M. P.