Web Survey Bibliography
a) Relevance & Research Question:
Swiss based market and social research institute LINK and the University of Applied Sciences Northwestern Switzerland collaborated on a two year project to develop methods to measure and reduce the bias of surveys, accomplished with the LINK web-panel, the largest Swiss panel with random selection.
b) Methods & Data:
The bias shall be reduced by applying a weighting scheme based on propensity scores. The success depends mainly on the choice of covariates.
To determine which variables serve best to model the response propensity we have conducted an experimental survey. In a CATI survey, people were asked questions concerning psychological characteristics (Big Five Scale), about their set of values (Schwartz Scale), about the perceived costs and benefits from surveys and their internet behavior. Simultaneously, the CATI served as a recruitment interview for the web-panel.
After checking which of the willing CATI respondentsactually did react to their first online survey invitation, we developed a model to predict the response behavior. This model allowed us to boil down the set of possible explaining variables, to a few. These variables are the basis for calculating the propensity scores.
To allow a thorough study of the resulting estimators and their variances we conduct Monte-Carlo-simulations. Observed missing value mechanisms have been implemented and modified to compare estimations with propensity-score weighted data with the universe.
c) Results:
The experimental survey has been conducted so far and could be analyzed. The response behavior has been modeled and some crucial variables have been identified. We can show the explanatory power of the proposed scales. The next step is to start the simulations. First results are expected by the end of the year.
d) Added Value:
Our project is a comprehensive study about applying propensity scores as a method to reduce bias in a well established web panel. We are able to implement easy to use methods in every day web-panel research.
Conference Homepage (abstract)
Web survey bibliography - Marketing/business (336)
- Effects of Response Formats when Measuring Attitudes in Consumer Web Surveys Across Markets.; 2011; Couper, M. P., Nunge, E.
- What it takes to be a top 100 website; 2010
- The multidimensional integral business survey response model; 2010; Bavdaz, M.
- Site-intercpet survey best practices; 2010; Henning, J.
- Overview of data collection methodology; 2010
- Demographics of mechanical Turk. Ceder working papers; 2010; Ipeirotis, P. G.
- Innovative mobile research in developing countries; 2010; Bellity, E.
- Mobile location based research: Cross cultural examination of coffee culture; 2010; Morden, M., Ferneyhough, C., Grenville, A.
- Online research….and all that Jazz!; 2010; Gittelman, S. H., Trimarchi, E.
- Why are we trying to create new communities for market research purposes?; 2010; Pearson, C., Kateley, V.
- Globalpark Annual Market Research Software Survey 2009; 2010; Macer, T., Wilson, S.
- An Analyze of the Zero Price Effect on Online Business Performance - An Research Based on the Mobile...; 2010; Liu, Y., Yuan, P.
- From clipboards to online research communities; 2010; Poynter, R., Cierpicki, S., Lorch, J., Zuo, B., Davis, C., Eddy, C.
- Codebook and explanatory note on the WageIndicator dataset ; 2010; Tijdens, K., van Zijl, S., Hughie-Williams, M., van Klaveren, M., Steinmetz, S.
- When the water is right.; 2010; Andruss, P.
- Time Related Inconsistencies in Global Online Panels; 2010; Gittelman, S. H., Trimarchi, E.
- Study of Non-Probability Sample Internet Surveys' Estimates of Consumer Product Usage and Demographic...; 2010; Yeager, D. S., Carter, A., Tewoldemedhin, H., Krosnick, J. A.
- Testing the Applicability of Respondent Driven Sampling as an Online Research Method to Sample Hidden...; 2010; Pajak, D.
- Enrichment of Qualitative Research through Online Approaches: New Insights due to Online CoCreation...; 2010; Krischke-Ramaswamy, M., Knorr, H.
- Theoretical model of context-sensitive mobile methods; 2010; Maxl, E.
- Using Propensity Score Weighting to Reduce Bias of a Swiss Market Research Web Panel; 2010; Wiegand, G., Jella, H., Beat, H., Stefan, L.
- Designing Web Surveys in Marketing Research: Does Use of Forced Answering Affect Completion Rates?; 2010; Albaum, G., Roster, C. A.,Wiley, J. B., Rossiter, J., Smith, S. M.
- The impact of incentives and interview methods on response quantity and quality in diary- and booklet...; 2010; Bonke, J., Fallesen, P.
- An Experiment With an Employment Sector Question; 2010; Finno, A. A., Kohout, J.
- Online polls burnish image - Daily tracking surveys are increasingly used by companies with dents on...; 2010; Bialik, C.
- Using the Delphi method to engage stakeholders: A comparison of two studies; 2010; Geist, M. R.
- Response format effects on measurement of employment; 2009; Thomas, R. K., Dillman, D. A., Smyth, J. D.
- MarketTools TrueSample; 2009
- ISO 26362 Access panels in market, opinion, and social research-Vocabulary and service requirements; 2009
- Exploring mode effects in a panel survey of new businesses; 2009; Santos, B., DesRoches, D.
- The 2008 Confirmit Annual Market Research Software Survey; 2009; Macer, T., Wilson, S.
- Measuring Internet And Press Audience In The Media Convergence Era. In Search Of A New Paradigm In Researching...; 2009; Pawlak, J., Póltorak, M.
- The Decline And Fall Of The Response Rate: The Fightback ; 2009; Green, A., Staplehurst, S., Windle, R.
- Effects of incentives and the Big Five personality dimensions on internet panellists' ratings; 2009; Larson, A. J., Sachau, D. A.
- Using Non-Probability Samples for Confusion Surveys - Mall Intercepts and the Internet; 2009; Ericksen, E. P.
- Factors Contributing to Participation in Web‐based Surveys among Italian University Graduates; 2009; Cimini, C., Girottu, C., Gasperoni, G.
- Integration of different data collection techniques using the propensity score; 2009; Camillo, F., Conti, V., Ghiselli, S.
- The Effect of Email Invitation Customization on Survey Completion Rates in an Internet Panel: A Meta...; 2009; Callegaro, M., Kruse, Y., Thomas, M., Nukulkij, P.
- Comparison Study of Early Adopter Attitudes and Online Behavior in Probability and Non-Probability Web...; 2009; Dennis, J. M., Osborn, L., Semans, K.
- Turning Grid Questions into Sequences in Business Web Surveys; 2009; Haraldsen, G., Bergstrøm, Y.
- The Electronic Questionnaire Experience in Business Surveys: mode effects on quality and on response...; 2009; Biffignandi, S., Siesto, G., Zeli, A.
- Findings from consumer surveys on Internet Shopping: A comparison of pre and post study consumer research...; 2009; Anonymous
- Representativeness of Mobile Internet Surveys - A comparative study of CAMI vs. CATI ; 2009; Maier, U., Neubarth, W., Grosser, A., Hombach, A.
- The use of online data-collection in financial services market measurement research : the FRS experience...; 2009; Cooke, M., Watkins, N.
- Market Research Online and Offline - Differences in output and processing of Qualitative Online and...; 2009; Knorr, H., Krischke-Ramaswamy, M.
- Volumetric Forecast based on Online Access Panels; 2009; Rodenhausen, T., Drewes, F.
- How representative are sentiments expressed in social media for the marketing target audience? A comparison...; 2009; Jarchow, C., Thomas, J.
- Advertising Effects of Online Video Ads; 2009; Wolf, M., Schönfeldt, J.
- Diffusion of Mobile Services Adoption in Taiwan; 2009; Doong, H.-S., Wang, H.-C.
- AGOF internet facts – increasing the response rate for onsite-surveys; 2009; Foerstel, H.