Web Survey Bibliography
a) Relevance & Research Question:
Swiss based market and social research institute LINK and the University of Applied Sciences Northwestern Switzerland collaborated on a two year project to develop methods to measure and reduce the bias of surveys, accomplished with the LINK web-panel, the largest Swiss panel with random selection.
b) Methods & Data:
The bias shall be reduced by applying a weighting scheme based on propensity scores. The success depends mainly on the choice of covariates.
To determine which variables serve best to model the response propensity we have conducted an experimental survey. In a CATI survey, people were asked questions concerning psychological characteristics (Big Five Scale), about their set of values (Schwartz Scale), about the perceived costs and benefits from surveys and their internet behavior. Simultaneously, the CATI served as a recruitment interview for the web-panel.
After checking which of the willing CATI respondentsactually did react to their first online survey invitation, we developed a model to predict the response behavior. This model allowed us to boil down the set of possible explaining variables, to a few. These variables are the basis for calculating the propensity scores.
To allow a thorough study of the resulting estimators and their variances we conduct Monte-Carlo-simulations. Observed missing value mechanisms have been implemented and modified to compare estimations with propensity-score weighted data with the universe.
c) Results:
The experimental survey has been conducted so far and could be analyzed. The response behavior has been modeled and some crucial variables have been identified. We can show the explanatory power of the proposed scales. The next step is to start the simulations. First results are expected by the end of the year.
d) Added Value:
Our project is a comprehensive study about applying propensity scores as a method to reduce bias in a well established web panel. We are able to implement easy to use methods in every day web-panel research.
Conference Homepage (abstract)
Web survey bibliography - Other (439)
- Why do you play? The development of the motives for online gaming questionnaire (MOGQ); 2011; Demetrovics, Z., Urbán, R., Nagygyörgy, K., Farkas, J., Zilahy, D., Mervó, B., Reindl, A., Agoston,...
- The “Frequency Divide” on Web Surveys: Opinions, Behaviours and Demographics Differences...; 2011; Reis, E., Vicente, P.
- LinkedIn and Facebook in Belgium: The Influences and Biases of Social Network Sites in Recruitment and...; 2011; Caers, R., Castelyns, V.
- PhD Students’ Research Group Networks. A Qualitative Approach; 2011; Coromina, L., Capo, A., Coenders, G., Guia, J.
- PhD Students’ Research Group Social Capital in Two Countries: A Clustering Approach with Duocentred...; 2011; Coenders, G., Coromina, L., Ferligoj, A., Guia, J.
- Preface; 2011; Coenders, G., Doreian, P.
- Explaining Unit Nonresponse in Online Panel Surveys: An Application of the Extended Theory of Planned...; 2011; Haunberger, S.
- Utilizing Web Technology in Business Data Collection: Some Norwegian, Dutch and Danish Experiences; 2011; Haraldsen, G., Snijkers, G., Roos, M., Sundvoll, A., Vik, T., Stax, H.-P.
- E-Census 2011 Portugal: implementation and results of the Pilot Survey; 2011; Vicente, P., Rosa, A., Reis, E.
- Standardising the web data collection channel at the Basque Statistics Office (EUSTAT); 2011; Prado, C., Guinea , C.
- An Experimental Investigation of Mode Effects in the Hungarian Census Test 2009; 2011; Vereczkei, Z.
- Effectiveness and consequences of various recruitment methods in psychological research: case study; 2011; Poltorak, M.
- Snap judgement polling; 2011; Anderson, K., Wright, M., Wheeler, M.
- Web based CATI on Amazon Elastic Compute Cloud and VirtualBox using queXS; 2011; Zammit, A.
- Web/Cloud Based CATI Using queXS; 2011; Zammit, A.
- Research on Internet survey errors and control methods; 2011; Mingyue, F., Xicang, Z.
- Does the direction of Likert-type scales influence response behavior in web surveys?; 2011; Keusch, F.
- Different functioning of rating scale formats – results from psychometric and physiological experiments...; 2011; Koller, M., Salzberger, T.
- A Comparison of CAPI and PAPI through a Randomized Field Experiment; 2011; De Weerdt, J.
- Changing research methods in Ukraine: CATI or Mixed-Mode Surveys?; 2011; Paniotto, V., Kharchenko, N.
- The Influence Of The Direction Of Likert-Type Scales In Web Surveys On Response Behavior In Different...; 2011; Keusch, F.
- Which Technologies Do Respondents Use in Online Surveys – An International Comparison?; 2011; Kaczmirek, L., Behr, D., Bandilla, W.
- Can Internet surveys help us understanding allergic disorders? – results from a large survey in...; 2011; Kalogeromitros, D., Psaltopoulou, T., Makris, M., Koti, I., Chliva, C., Stefanadi, E., Hatziagelaki,...
- E-survey (surveys based on e-mail & web) Analysis and identification of cold responsive proteins in...; 2011; Sodabeh, J.-G., Ferdous, R.-J., Lello, Z., Ghasem, K., Ghasem, H. S., Gholipoori, A., Siroos, M., Sajjad...
- Development of a web-based survey system for evaluating affective satisfaction ; 2011; Cho, Y., Han, S. H., Kang, S., Park, J.
- A Method for Evaluating Mode Effects in Mixed-mode Surveys; 2011; Vannieuwenhuyze, J., Loosveldt, G., Molenberghs, G.
- Handle with Care: The Impact of Using Java Applets in Web-Based Studies on Dropout and Sample Composition...; 2011; Stieger, S., Goeritz, A., Voracek, M.
- An overview of Internet-based surveys in hospitality and tourism journals; 2011; Hung, K., Law, R.
- Measuring Political Knowledge in Telephone and Web Surveys: A Cross-National Comparison; 2011; Strabac, Z., Aalberg, T.
- Response Rates in Organizational Science, 1995–2008: A Meta-analytic Review and Guidelines for...; 2010; Anseel, F., Lievens, F., Schollaert, E., Choragwicka, B.
- Developing a web explicit research strategy theory in African universities: a cross-comparison of specific...; 2010; Kirigha, K. A., Neema-A.
- Maximizing online respondent engagement through a game-way research design; 2010; Swahar, G., Swahar, J.
- Online panel survey, Change and stability of political attitudes; 2010
- Social Networking Sites: Evaluating and Investigating their use in Academic Research; 2010; Redmond, F.
- An Analyze of the Zero Price Effect on Online Business Performance - An Research Based on the Mobile...; 2010; Liu, Y., Yuan, P.
- Dealing with Nonresponse in Survey Sampling: an Item Response Modeling Approach; 2010; Matei, A.
- Blogosphere and Democracy in Portugal–Results of a Websurvey; 2010; Carvalho, T., Casanova, J. L.
- Establishing a Qualitative Data Archive in Austria; 2010; Smioski, A.
- Web Based Paper Form Verification Using QueXF; 2010; Zammit, A.
- Does Making The Survey Topic More Salient Lead To An Expert Bias? – The Influence of Announcing...; 2010; Keusch, F., Mayerhofer, W., Weilbuchner, N., Jungreithmaier, S.
- Developing and Evaluating a Student Online Panel.; 2010; Stiglbauer, B., Gamsjäger, M., Gnambs, T., Batinic, B., Altrichter, H.
- Online Access Panels: A detailed look at different Ways of Entering, their Costs and Participation Behavior...; 2010; Führer, R., Keusch, F.
- Theoretical model of context-sensitive mobile methods; 2010; Maxl, E.
- Can a professional questionnaire layout make up for a boring topic? The mediating role of topic interest...; 2010; Keusch, F., Mayerhofer, W., Jungreithmaier, S., Weilbuchner, N., Fuehrer, R., Kling, H.
- Using Propensity Score Weighting to Reduce Bias of a Swiss Market Research Web Panel; 2010; Wiegand, G., Jella, H., Beat, H., Stefan, L.
- Combining Link-Tracing Sampling and Cluster Sampling to Estimate Totals and Means of Hidden Human Populations...; 2010; Félix-Medina, M. H., Monjardin, P. E.
- Quality in Unimode and Mixed-Mode designs: A Multitrait-Multimethod approach; 2010; Revilla, M.
- Some Notes on the Probability Space of Statistical Surveys; 2010; Petrakos, G.
- Web panels: Replacement technology for market research; 2010; Goeritz, A.
- Color red in web-based knowledge testing; 2010; Gnambs, T., Batinic, B., Appel, Ma.