Web Survey Bibliography
Relevance/Research Question: The increasing use of volunteer web-surveys has often been criticized as their results are not representative for the population of interest. While the discussion has mainly focused on different weighting techniques to correct for selection biases, this study addresses the question whether the bias of such samples might be corrected through specific mass media attention. Scientific literature, so far, has not addressed the different recruitment strategies of volunteer web-surveys in more detail. The knowledge of how to reach a large and heterogeneous group via web-marketing has, however, increased tremendously. Our study aims to explore whether selection bias in a volunteer web-survey might be tackled through media attention. Three sub-questions are addressed: How long does the effect of media attention last on average? Does the sample composition change in the periods of massive media attention? Which sample characteristics are subject to changes?
Methods/Data: The 2009-2013 data from the continuous, volunteer German WageIndicator web-survey (Lohnspiegel) will be used. The Lohnspiegel website has a ‘Salary Checker‘ where web visitors can calculate their monthly wages, based on the survey data. Since 2009, the overregional newspaper ‘Bild Zeitung’ has published every six months on its first page the top-hundred highest earning occupations. First, we analyse the change in the number of web visitors per day (prior and posterior to the event) via Google analytics. Second, we divide the sample between the period of increased and regular web visits and compare the two samples for socio-demographic and work-related characteristics.
Results: The preliminary findings show that in periods of mass media attention the number of visitors doubles and the number of questionnaire submissions increases fourfold. However, for the composition of the sample hardly any effects can be observed. This implies that groups so far underrepresented in the web-sample are hardly motivated to take part in a survey through mass media events.
Added Value: This topic has not been addressed in the scientific discussion about volunteer web-surveys. Therefore, it will offer new insights and an alternative approach to deal with selection biases in volunteer web-surveys.
Web survey bibliography - General Online Research Conference (GOR) 2014 (29)
- Using Paradata to Predict and to Correct for Panel Attrition in a Web-based Panel Survey; 2014; Rossmann, J., Gummer, T.
- Targeting the bias – the impact of mass media attention on sample composition and representativeness...; 2014; Steinmetz, S., Oez, F., Tijdens, K. G.
- Offline Households in the German Internet Panel; 2014; Bossert, D., Holthausen, A., Krieger, U.
- Which fieldwork method for what target group? How to improve response rate and data quality; 2014; Wulfert, T., Woppmann, A.
- Exploring selection biases for developing countries - is the web a promising tool for data collection...; 2014; Tijdens, K. G., Steinmetz, S.
- Evaluating mixed-mode redesign strategies against benchmark surveys: the case of the Crime Victimization...; 2014; Klausch, L. T., Hox, J., Schouten, B.
- The quality of ego-centered social network data in web surveys: experiments with a visual elicitation...; 2014; Marcin, B., Matzat, U., Snijders, C.
- Switching the polarity of answer options within the questionnaire and using various numbering schemes...; 2014; Struminskaya, B., Schaurer, I., Bosnjak, M.
- Measuring the very long, fuzzy tail in the occupational distribution in web-surveys; 2014; Tijdens, K. G.
- Social Media and Surveys: Collaboration, Not Competition; 2014; Couper, M. P.
- Improving cheater detection in web-based randomized response using client-side paradata; 2014; Dombrowski, K., Becker, C.
- Interest Bias – An Extreme Form of Self-Selection?; 2014; Cape, P. J., Reichert, K.
- Online Qualitative Research – Personality Matters ; 2014; Tress, F., Doessel, C.
- Increasing data quality in online surveys 4.1; 2014; Hoeckel, H.
- Moving answers with the GyroScale: Using the mobile device’s gyroscope for market research purposes...; 2014; Luetters, H., Kraus, M., Westphal, D.
- Online Surveys as a Management Tool for Monitoring Multicultual Virtual Team Processes; 2014; Scovotti, C.
- How much is shorter CAWI questionnaire VS CATI questionnaire?; 2014; Bartoli, B.
- WEBDATANET: A Network on Web-based Data Collection, Methodological Challenges, Solutions, and Implementation...; 2014; Tijdens, K. G., Steinmetz, S., de Pedraza, P., Serrano, F.
- The Use of Paradata to Predict Future Cooperation in a Panel Study; 2014; Funke, F., Goeritz, A.
- Incentives on demand in a probability-based online panel: redemption and the choice between pay-out...; 2014; Schaurer, I., Struminskaya, B., Kaczmirek, L.
- The Effect of De-Contextualisation - A Comparison of Response Behaviour in Self-Administered Surveys; 2014; Wetzelhuetter, D.
- Responsive designed web surveys; 2014; Dreyer, M., Reich, M., Schwarzkopf, K.
- Extra incentives for extra efforts – impact of incentives for burdensome tasks within an incentivized...; 2014; Schreier, J. H., Biethahn, N., Drewes, F.
- Students First Choice – the influence of mobile mode on results; 2014; Maxl, E.
- Device Effects: How different screen sizes affect answer quality in online questionnaires; 2014; Fischer, B., Bernet, F.
- Moving towards mobile ready web panels; 2014; Wijnant, A., de Bruijne, M.
- Innovation for television research - online surveys via HbbTV. A new technology with fantastic opportunities...; 2014; Herche, J., Adler, M.
- Mixed-devices in a probability based panel survey. Effects on survey measurement error; 2014; Toepoel, V., Lugtig, P. J.
- Online mobile surveys in Italy: coverage and other methodological challenges; 2014; Poggio, T.