Web Survey Bibliography
a) Relevance & Research Question:
Swiss based market and social research institute LINK and the University of Applied Sciences Northwestern Switzerland collaborated on a two year project to develop methods to measure and reduce the bias of surveys, accomplished with the LINK web-panel, the largest Swiss panel with random selection.
b) Methods & Data:
The bias shall be reduced by applying a weighting scheme based on propensity scores. The success depends mainly on the choice of covariates.
To determine which variables serve best to model the response propensity we have conducted an experimental survey. In a CATI survey, people were asked questions concerning psychological characteristics (Big Five Scale), about their set of values (Schwartz Scale), about the perceived costs and benefits from surveys and their internet behavior. Simultaneously, the CATI served as a recruitment interview for the web-panel.
After checking which of the willing CATI respondentsactually did react to their first online survey invitation, we developed a model to predict the response behavior. This model allowed us to boil down the set of possible explaining variables, to a few. These variables are the basis for calculating the propensity scores.
To allow a thorough study of the resulting estimators and their variances we conduct Monte-Carlo-simulations. Observed missing value mechanisms have been implemented and modified to compare estimations with propensity-score weighted data with the universe.
c) Results:
The experimental survey has been conducted so far and could be analyzed. The response behavior has been modeled and some crucial variables have been identified. We can show the explanatory power of the proposed scales. The next step is to start the simulations. First results are expected by the end of the year.
d) Added Value:
Our project is a comprehensive study about applying propensity scores as a method to reduce bias in a well established web panel. We are able to implement easy to use methods in every day web-panel research.
Conference Homepage (abstract)
Web survey bibliography - 2010 (251)
- Running experiments on Amazon Mechanical Turk; 2010; Paolacci, G., Chandler, J., Ipeirotis, P. G.
- Making Good Use of Survey Paradata; 2010; Lynn, P., Nicolaas, G.
- Questionnaire Length, Fatigue Effects and Response Quality Revisited; 2010; Cape, P. J.
- Preventing Satisficing in Online Surveys: A “Kapcha” to Ensure Higher Quality Data...; 2010; Chandler, D., Kapelner, A.
- Game on; 2010; Ewing, T.
- Respondent Engagement: How Much Does it Matter?; 2010
- The Internet and Social Inequalities; 2010; Mannon, S.E.; Witte, J. C.
- Need to Improve Routine HIV Testing of U.S. Veterans in Care: Results of an Internet Survey; 2010; Valdiserri, R. O., Nazi, K., McInnes, D. K., Ross, D., Kinsinger, L.
- The Prevalence of Chronic Pain in United States Adults: Results of an Internet-Based Survey; 2010; Johannes, C. B., Le, T. K., Zhou, X., Johnston, J. A., Dworkin, R. H.
- Response Rates in Organizational Science, 1995–2008: A Meta-analytic Review and Guidelines for...; 2010; Anseel, F., Lievens, F., Schollaert, E., Choragwicka, B.
- Marketing Research: Methodological Foundations; 2010; Iacobucci, D., Churchill, G.A. Jr.
- Computer Assisted Interview Testing Tool (CTT) - a review of new features and how the tool has improved...; 2010; Stark, R., Gatward, R.
- Address-based Sampling Nets Success for KnowledgePanel® Recruitment and Sample Representation; 2010; DiSogra, C.
- A method of automated nonparametric content analysis for social science; 2010; Hopkins, D. J., King, G.
- Developing a web explicit research strategy theory in African universities: a cross-comparison of specific...; 2010; Kirigha, K. A., Neema-A.
- The use of paradata to monitor and manage survey data collection; 2010; Kreuter, F., Couper, M. P., Lyberg, L. E.
- Mitigating Online Survey Nonresponse Error In Aviation Research; 2010; Ison, D. C.
- Optimizing response rates in online surveys; 2010; Kaczmirek, L.
- The Decision Maker's Guide to Online Research; 2010
- Mixed-Method Approaches to Social Network Analysis; 2010; Edwards, G.
- Measuring Intent to Participate and Participation in the 2010 Census and Their Correlates and Trends...; 2010; Pasek, J., Krosnick, J. A.
- Nonresponse and Measurement Error in Mobile Phone Surveys ; 2010; Kennedy, C.
- Wordle; 2010; Feinberg, J.
- What it takes to be a top 100 website; 2010
- Total Survey Error: past, present, and future; 2010; Groves, R. M., Lyberg, L. E.
- There is an app for that! A review of smartphone apps for marketing research; 2010; Michelson, M.
- The who, what, and where of America: Understanding the American Community Survey; 2010; Gaquin, D. A.
- The weirdest people in the world?; 2010; Heine, S. J., Henrich, J., Norenzayan, A.
- The state of online research in the U.S.; 2010; Miller, J.
- The psychology or survey response. An ASA webinar; 2010; Tourangeau, R.
- The psychology of survey response, 2nd Edition; 2010; Tourangeau, R., Bradburn, N. M.
- The multidimensional integral business survey response model; 2010; Bavdaz, M.
- The impact of next and back buttons on time to complete and measurement reliability in computer-based...; 2010; Hays, R. D., Bode, R., Rothrock, N., Riley, W., Cella, D., Gershon, R.
- The Gallup Poll: Public opinion 2009; 2010; Gallup, A. M.
- Surveying cultures: Discovering shared conceptions and sentiments; 2010; Heise, D. R.
- Site-intercpet survey best practices; 2010; Henning, J.
- Sampling: design and analysis, 2nd Edition; 2010; Lohr, S. L.
- Research synthesis. AAPOR report on online panels; 2010; Brick, J. M., Baker, R., Blumberg, S. J., Couper, M. P., Courtright, M., Dennis, J. M., Dillman, D....
- Recruiting probability samples for a multi-mode research panel with Internet and mail components; 2010; Rao, K.
- Real ID. State of The Art Representative and Repeatable Online Samples. Behaviorally Profiled Respondents...; 2010; Gittelman, S. H., Trimarchi, E.
- Randomized response and indirect questioning techniques in surveys; 2010; Chaudhuri, A.
- Protecting and accessing data from the survey of earned doctorates: A workshop summary; 2010; Plewes, T. J.
- Paradata: a new data source from web-administered measures; 2010; Sowan, A. K., Jenkins, L. S.
- Overview of data collection methodology; 2010
- On-the-go and in-the-moment. Mobile research offers speed, immediacy; 2010; Pferdekamper, T.
- Mixed-mode surveys; 2010; Dillman, D. A., Messer, B. L.
- Measuring the group quarters population in the American Community Survey: Interim report; 2010; Marton, K., Voss, P. R.
- Measures of interobserver agreement and reliability; 2010; Shoukri, M. M.
- Machines that lean how to code open ended survey data; 2010; Esuli, A., Sebastiani, F.
- Libraries nationwide receiving ALA-APA Library Salary Survey Invitation; 2010; Grady, J.