Web Survey Bibliography
This paper deals with identifying and correcting errors related to question wording in the questionnaire design step of the survey process. Each question can be worded in numerous ways which are not equivalent in terms of comprehensibility - some wordings are more familiar than others. In practice, absolute frequencies in language corpora can be used as estimates of wording familiarity. Supposedly, wordings with a higher frequency are more comprehensible to the respondent. Words with low frequencies can be replaced with synonyms or other similar words that can be found in thesauri. We took the Wageindicator Questionnaire as a case study to explore how to use these linguistic resources to identify and correct errors in question wording.
The WageIndicator survey is used to collect data on wages and labour conditions in different countries. It is an online survey that uses a convenience, self-selected non-probability samples. The word count of the English version of the questionnaire is 6.181 words. We checked the word frequency of all nouns, verbs, adjectives and adverbs and made a list with all those that had a word frequency (based on the British National Corpus) in the lower 25%. We looked up for synonyms and other possible alternative words for these words and made a final selection of wordings that we used in a wording experiment: the original wordings were submitted to the control group, while questions with changed wordings were asked to the experimental group. We measured response times, drop-outs, item non-response, satisficing and respondent satisfaction in both groups. Based on the preliminary results we recommend further research on the potential of language resources that could help survey practitioners to identify problematic question wordings and suggest corrections.
Web survey bibliography - Tijdens, K. G. (18)
- Self-identification of occupation in web surveys: requirements for search trees and look-up tables ; 2015; Tijdens, K. G.
- Identifying and correcting question-wording problems: the case of Wageindicator; 2015; Slavec, A., Vehovar, V., Tijdens, K. G.
- WEBDATANET: Innovation and Quality in Web-Based Data Collection ; 2014; Steinmetz, S., Slavec, A., Tijdens, K. G., Reips, U.-D., de Pedraza, P., Popescu, A., Belchior, A., ...,...
- Improving web survey quality; 2014; Steinmetz, S., Bianchi, S. M., Tijdens, K. G., Biffignandi, S.
- Targeting the bias – the impact of mass media attention on sample composition and representativeness...; 2014; Steinmetz, S., Oez, F., Tijdens, K. G.
- Exploring selection biases for developing countries - is the web a promising tool for data collection...; 2014; Tijdens, K. G., Steinmetz, S.
- Measuring the very long, fuzzy tail in the occupational distribution in web-surveys; 2014; Tijdens, K. G.
- Dropout Rates and Response Times of an Occupation Search Tree in a Web Survey; 2014; Tijdens, K. G.
- WEBDATANET: A Network on Web-based Data Collection, Methodological Challenges, Solutions, and Implementation...; 2014; Tijdens, K. G., Steinmetz, S., de Pedraza, P., Serrano, F.
- Challenges and pitfalls of measuring wages via web surveys - some explorations; 2012; Steinmetz, S., Bianchi, A., Tijdens, K., Biffignandi, S.
- Understanding selection bias in a worldwide, volunteer web-survey; 2012; Tijdens, K., Steinmetz, S.
- Hrh remuneration: Comparing wage levels, ranking And dispersion of 16 occupations In the health workforce...; 2011; Tijdens, K., de Vries, D.
- Wages worldwide results and measurement issues from the multi-country. WageIndicator web-survey ; 2011; van Klaveren, M., Tijdens, K.
- Text string matching to measure occupations in web-surveys; 2011; Tijdens, K. G.
- Codebook and explanatory note on the WageIndicator dataset ; 2010; Tijdens, K., van Zijl, S., Hughie-Williams, M., van Klaveren, M., Steinmetz, S.
- Potentials and Constraints of Propensity Score Weighting to Improve Web Survey Quality; 2010; Steinmetz, S., Tijdens, K.
- Presentation of WEBSURVNET; 2009; de Pedraza, P., Steinmetz, S., Tijdens, K.
- Sample bias, weights and efficiency of weights in a continuous web voluntary survey; 2007; de Pedraza, P., Tijdens, K., de Bustillo, R.