Web Survey Bibliography
Relevance/Research Question: The increasing use of volunteer web-surveys has often been criticized as their results are not representative for the population of interest. While the discussion has mainly focused on different weighting techniques to correct for selection biases, this study addresses the question whether the bias of such samples might be corrected through specific mass media attention. Scientific literature, so far, has not addressed the different recruitment strategies of volunteer web-surveys in more detail. The knowledge of how to reach a large and heterogeneous group via web-marketing has, however, increased tremendously. Our study aims to explore whether selection bias in a volunteer web-survey might be tackled through media attention. Three sub-questions are addressed: How long does the effect of media attention last on average? Does the sample composition change in the periods of massive media attention? Which sample characteristics are subject to changes?
Methods/Data: The 2009-2013 data from the continuous, volunteer German WageIndicator web-survey (Lohnspiegel) will be used. The Lohnspiegel website has a ‘Salary Checker‘ where web visitors can calculate their monthly wages, based on the survey data. Since 2009, the overregional newspaper ‘Bild Zeitung’ has published every six months on its first page the top-hundred highest earning occupations. First, we analyse the change in the number of web visitors per day (prior and posterior to the event) via Google analytics. Second, we divide the sample between the period of increased and regular web visits and compare the two samples for socio-demographic and work-related characteristics.
Results: The preliminary findings show that in periods of mass media attention the number of visitors doubles and the number of questionnaire submissions increases fourfold. However, for the composition of the sample hardly any effects can be observed. This implies that groups so far underrepresented in the web-sample are hardly motivated to take part in a survey through mass media events.
Added Value: This topic has not been addressed in the scientific discussion about volunteer web-surveys. Therefore, it will offer new insights and an alternative approach to deal with selection biases in volunteer web-surveys.
Web survey bibliography - Tijdens, K. G. (18)
- Self-identification of occupation in web surveys: requirements for search trees and look-up tables ; 2015; Tijdens, K. G.
- Identifying and correcting question-wording problems: the case of Wageindicator; 2015; Slavec, A., Vehovar, V., Tijdens, K. G.
- WEBDATANET: Innovation and Quality in Web-Based Data Collection ; 2014; Steinmetz, S., Slavec, A., Tijdens, K. G., Reips, U.-D., de Pedraza, P., Popescu, A., Belchior, A., ...,...
- Improving web survey quality; 2014; Steinmetz, S., Bianchi, S. M., Tijdens, K. G., Biffignandi, S.
- Targeting the bias – the impact of mass media attention on sample composition and representativeness...; 2014; Steinmetz, S., Oez, F., Tijdens, K. G.
- Exploring selection biases for developing countries - is the web a promising tool for data collection...; 2014; Tijdens, K. G., Steinmetz, S.
- Measuring the very long, fuzzy tail in the occupational distribution in web-surveys; 2014; Tijdens, K. G.
- Dropout Rates and Response Times of an Occupation Search Tree in a Web Survey; 2014; Tijdens, K. G.
- WEBDATANET: A Network on Web-based Data Collection, Methodological Challenges, Solutions, and Implementation...; 2014; Tijdens, K. G., Steinmetz, S., de Pedraza, P., Serrano, F.
- Challenges and pitfalls of measuring wages via web surveys - some explorations; 2012; Steinmetz, S., Bianchi, A., Tijdens, K., Biffignandi, S.
- Understanding selection bias in a worldwide, volunteer web-survey; 2012; Tijdens, K., Steinmetz, S.
- Hrh remuneration: Comparing wage levels, ranking And dispersion of 16 occupations In the health workforce...; 2011; Tijdens, K., de Vries, D.
- Wages worldwide results and measurement issues from the multi-country. WageIndicator web-survey ; 2011; van Klaveren, M., Tijdens, K.
- Text string matching to measure occupations in web-surveys; 2011; Tijdens, K. G.
- Codebook and explanatory note on the WageIndicator dataset ; 2010; Tijdens, K., van Zijl, S., Hughie-Williams, M., van Klaveren, M., Steinmetz, S.
- Potentials and Constraints of Propensity Score Weighting to Improve Web Survey Quality; 2010; Steinmetz, S., Tijdens, K.
- Presentation of WEBSURVNET; 2009; de Pedraza, P., Steinmetz, S., Tijdens, K.
- Sample bias, weights and efficiency of weights in a continuous web voluntary survey; 2007; de Pedraza, P., Tijdens, K., de Bustillo, R.