Web Survey Bibliography
Relevance & Research Question:
Compared to other survey modes, web-surveys are more easily conducted worldwide. Due to the absence of proper sampling frames, most of these surveys will be volunteer surveys, either inviting respondents from an Internet panel or inviting web-visitors to complete a survey. For the latter ones, there is a three-step selection process, namely through the access to Internet, the interest in the website's topic and the decision to take up the web-survey. While most studies so far analysed selection bias for one or a few countries, this paper firstly explores the nature of selection bias for 28 countries and secondly analyses in how far cross-national differences in the observed selection bias can be attributed to explanations related to Internet access and social and cultural indices.
Methods & Data:
The paper analyses data of the worldwide, continuous, volunteer, multilingual, cross-country comparable WageIndicator web-survey on work and wages. Using the 2010 web-survey data, for the 28 countries of interest, simple weights have been computed for six categories (gender * 3 age groups) using labour force projection data from the International Labour Organisation (ILO). Country-level explanatory variables were taken from Internet Access Tables and from the Indices of Social Development (ISD-database). Besides the usual description of selection biases, multi-level analysis has been applied in order to account for differences within and between countries in an appropriate way.
Results:
Not surprisingly, in almost all countries, the underrepresentation in the survey increases with age. Moreover, in all age groups it is higher for women than for men. Across countries, the ISD “intergroup_cohesion” index correlates negatively with the underrepresentation of women aged 40+ (-0.62) and 30-39 (-.58). The “civic_activism” index only correlates negatively with the underrepresentation of women aged 40+ (-0.44). Surprisingly, the “gender_equality” index does not correlate with women's underrepresentation.
Added value:
Most studies about selection bias have focused on one or a few countries, exploring within-country differences. Thanks to a large number of observations in a large number of countries, this paper adds to the body of knowledge by introducing country-level explanations for differences in response to volunteer web-surveys.
Conference Homepage (abstract) / (full text)
Web survey bibliography - Tijdens, K. G. (18)
- Self-identification of occupation in web surveys: requirements for search trees and look-up tables ; 2015; Tijdens, K. G.
- Identifying and correcting question-wording problems: the case of Wageindicator; 2015; Slavec, A., Vehovar, V., Tijdens, K. G.
- WEBDATANET: Innovation and Quality in Web-Based Data Collection ; 2014; Steinmetz, S., Slavec, A., Tijdens, K. G., Reips, U.-D., de Pedraza, P., Popescu, A., Belchior, A., ...,...
- Improving web survey quality; 2014; Steinmetz, S., Bianchi, S. M., Tijdens, K. G., Biffignandi, S.
- Targeting the bias – the impact of mass media attention on sample composition and representativeness...; 2014; Steinmetz, S., Oez, F., Tijdens, K. G.
- Exploring selection biases for developing countries - is the web a promising tool for data collection...; 2014; Tijdens, K. G., Steinmetz, S.
- Measuring the very long, fuzzy tail in the occupational distribution in web-surveys; 2014; Tijdens, K. G.
- Dropout Rates and Response Times of an Occupation Search Tree in a Web Survey; 2014; Tijdens, K. G.
- WEBDATANET: A Network on Web-based Data Collection, Methodological Challenges, Solutions, and Implementation...; 2014; Tijdens, K. G., Steinmetz, S., de Pedraza, P., Serrano, F.
- Challenges and pitfalls of measuring wages via web surveys - some explorations; 2012; Steinmetz, S., Bianchi, A., Tijdens, K., Biffignandi, S.
- Understanding selection bias in a worldwide, volunteer web-survey; 2012; Tijdens, K., Steinmetz, S.
- Hrh remuneration: Comparing wage levels, ranking And dispersion of 16 occupations In the health workforce...; 2011; Tijdens, K., de Vries, D.
- Wages worldwide results and measurement issues from the multi-country. WageIndicator web-survey ; 2011; van Klaveren, M., Tijdens, K.
- Text string matching to measure occupations in web-surveys; 2011; Tijdens, K. G.
- Codebook and explanatory note on the WageIndicator dataset ; 2010; Tijdens, K., van Zijl, S., Hughie-Williams, M., van Klaveren, M., Steinmetz, S.
- Potentials and Constraints of Propensity Score Weighting to Improve Web Survey Quality; 2010; Steinmetz, S., Tijdens, K.
- Presentation of WEBSURVNET; 2009; de Pedraza, P., Steinmetz, S., Tijdens, K.
- Sample bias, weights and efficiency of weights in a continuous web voluntary survey; 2007; de Pedraza, P., Tijdens, K., de Bustillo, R.