Web Survey Bibliography
Relevance & Research Question:
According to ESOMAR, online survey is already the most popular quantitative market research technique in the world (regarding research spending and number of interviews). The results of studies conducted via the Internet are frequently extrapolated to general populations and/or compared to results obtained by other modes. And thus the questions appear: Whether and in what circumstances could such generalisations be accurate, given limited coverage and systematic nonresponse error in online samples? Is the sole correction of socio-demographic quota enough to ensure results validity? If not, what other sample characteristics shall be controlled? Do the comparisons of online and offline results always make sense? How big is the impact of sampling effect and technique effect?
Methods & Data:
To answer the above questions we conducted a set of online and offline studies in 2009 and 2010. We paid a special attention to keeping different modes of measurements equivalent, according to timing, wording and look of the questions etc. We considered various research phenomena and various features for correction. The final study, which we will focus on here, took place in May 2010, in Poland. We gathered 3006 questionnaires from personal interviews, 5485 from online on-site recruitment and 6399 from online AccessPanel were gathered. The comparisons comprised of raw data results as well as of data weighed in various ways.
Results:
Demographic data correction makes online results better estimate some offline results, for some populations. However, just including additionally non-demographic characteristics put the modes differences within the bounds of a random error. Not all straight comparisons of online and offline results make sense. A technique and interviewer effects are for a range of phenomena not removable. We are going to show all the above in details during our speech.
Added Value:
The presentation will provide the audience with valuable insights of what needs to be known and controlled in online research to ensure high quality and validity of the results and when offline results can be a real reference to online. The topic shall be of interest not only for market researchers but also for academics.
GOR Homepage (abstract) / (full text)
Web survey bibliography - General Online Research Conference (GOR) 2012 (26)
- Is „chapterisation“ a viable alternative to traditional progress indicators ?; 2012; Spicer, R., Dowling, Z.
- Exploring New Pathways to Survey Recruitment; 2012; Bilgram, V., Stadler, D.Jawecki, G.
- Understanding selection bias in a worldwide, volunteer web-survey; 2012; Tijdens, K., Steinmetz, S.
- Does Mode Matter? Initial Evidence from the German Longitudinal Election Study (GLES); 2012; Blumenstiel, J. E., Rossmann, J.
- The Representativity of Web Surveys of the General Population compared to Traditional Modes and Mixed...; 2012; Klausch, L. T., Schouten, B., Hox, J.
- Surveytainment 2.0: Why investing 10 more minutes more in constructing your questionnaire is worth considering...; 2012; Muehle, A., Tress, F., Schmidt, S., Winkler, T.
- Market research online community (MROC) versus focus group; 2012; Zuber, M.
- Data quality in MAWI and CAWI; 2012; Mavletova, A. M., Blasius, J.
- Time use data collection using Smartphones: Results of a pilot study among experienced and inexperienced...; 2012; Scherpenzeel, A., Sonck, N., Fernee, H., Morren, Me.
- Scrutinizing Dynamics – Rolling panel waves in theory and practice; 2012; Faas, T., Blumenberg, J. N.
- Little experience with technology as a cause of nonresponse in online surveys; 2012; Struminskaya, B., Schaurer, I., Kaczmirek, L., Bandilla, W.
- Automatic Forwarding on Web Surveys – Some Outlines and Remarks; 2012; Selkaelae, A.
- Thinking, Planning & Operationalizing Empirical Mixed Methods Research Design; 2012; Ruhi, U.
- Continuous large-scale volunteer web-surveys: The experience of Lohnspiegel and WageIndicator; 2012; Oez, F.
- Is Pretesting Established Among Online Survey Tool Users?; 2012
- An Evaluation of Two Non-Reactive Web Questionnaire Pretesting Methods; 2012; Lenzner, T.
- Recommendations for implementing online surveys and simple experiments in social and behavioural research...; 2012; Hewson, C. M.
- High potential for mobile Web surveys: Findings from a survey representative for German Internet users...; 2012; Funke, F., Wachenfeld, A.
- A taxonomy of paradata for web surveys and computer assisted self interviewing (Casi); 2012; Callegaro, M.
- Can Social Media Research replace traditional research methods?; 2012; Faber, T., Einhorn, M., Hofmann, O., Loeffler, M.
- Bad Boy Matrix Question – Whatcha gonna do when they come for you?; 2012; Tress, F.
- Matrix vs. Single Question Formats in Web Surveys: Results from a large scale experiment; 2012; Klausch, L. T., de Leeuw, E. D., Hox, J., de Jongh, A., Roberts , A.
- Effects of Static versus Dynamic Formatting Instructions for Open-Ended Numerical Questions in Web Surveys...; 2012; Kunz, T., Fuchs, M.
- FamilyVote – Conducting online surveys with children and families; 2012; Geissler, H., Peeters, H.
- The influence of social desirability on data quality in face-to-face and web surveys; 2012; Keusch, F.
- Reducing the Threat of Sensitive Questions in Online Surveys; 2012; Couper, M. P.