Web Survey Bibliography
Web surveys are usually characterized by massive non response and undercoverage. A popular way to deal with these problem in the sampling literature is by means of weighting observations in the estimation process. If the population totals of some auxiliary variables are accurately known poststratification or, more in general, calibration methods can be used to reduce both non-response and undercoverage bias (Sarndal and Lundstrom, 2oo5). They are based on the correction of a set of ‘basic weights’, i.e. the inverse of the inclusion probabilities when sampling is random. Alternatively an estimated propensity score is sometimes used to create a weight adjustment to account for nonresponse in surveys where some variables are known for both respondents and nonrespondents (Little and Rubin, 1987).
When correction of basic weights is substantial the resulting weights may be characterized by high variability and a skewed distribution with extreme values. This may have a bad impact of the mean square error of estimators. In fact the reduction in the bias may be overcome by an increase in the variance. This is true especially when non response is noninformative, that is the probability of being a respondent is independent of the study variables.
Compromise solutions may be obtained by means of weight trimming or smoothing (Elliot and Little, 2000). In the case of calibration we may also modify the distance function for the same purposes.
In this paper we deal with several problems related to weighting, such as variable selection in building propensity scores and calibration, comparison of different trimming threshold and smoothing methods. We are also interested in evaluating the impact of ‘basic’ or ‘initial’ weights on final weights. This problem is relevant for those web surveys in which it is not possible to obtain basic weights as inverse inclusion probabilities. We illustrate these problems using data from a web survey conducted on a population of university students. More detail we consider a survey on a stratified random sample of students from the University of Bergamo, contacted via e-mail and asked to complete a customer satisfaction questionnaire on the University library services on the internet.
Workshop Homepage (presentation)
Web survey bibliography - Biffignandi, S. (17)
- Targeted letters: Effects on sample composition and item non-response; 2017; Bianchi, A.; Biffignandi, S.
- Web-respondent-driven sampling; 2014; Bianchi, A., Biffignandi, S., Artaz, R.
- Improving web survey quality; 2014; Steinmetz, S., Bianchi, S. M., Tijdens, K. G., Biffignandi, S.
- Web Panel Representativeness; 2013; Bianchi, A., Biffignandi, S.
- Responsive design for mixed-mode panel data; 2013; Bianchi, A., Biffignandi, S.
- Responsive Design for Web Panel Data Collection; 2013; Bianchi, A., Biffignandi, S.
- Innovation in Data Collection: the Responsive Design Approach; 2013; Bianchi, A., Biffignandi, S.
- Online Data Collection in the Agro-Food Sector; 2012; Biffignandi, S., Artaz, R.
- Panel retention rate and data quality: experimental results drawing on Reciprocity design; 2012; Biffignandi, S., Artaz, R.
- Challenges and pitfalls of measuring wages via web surveys - some explorations; 2012; Steinmetz, S., Bianchi, A., Tijdens, K., Biffignandi, S.
- Web Surveys: Methodological Problems and Research Perspectives; 2012; Biffignandi, S., Bethlehem, J.
- Using survey data collection as a tool for improving the survey process; 2011; Biffignandi, S., Perani, G., Laureti, A.
- Modeling non-sampling errors and participation in Web surveys; 2010; Biffignandi, S.
- Imperfect frames and new data collection techniques ; 2009; Biffignandi, S.
- An experiment on the effects of non-response reweighting on estimators' precision in a web survey; 2009; Fabrizi, E., Biffignandi, S., Toninelli, D.
- The Electronic Questionnaire Experience in Business Surveys: mode effects on quality and on response...; 2009; Biffignandi, S., Siesto, G., Zeli, A.
- Calibration and Propensity Score Weighting in Web Surveys; 2007; Fabrizi, E., Biffignandi, S.