Web Survey Bibliography
Title Tracking the Representativeness of an Online Panel Over Time
Author Klausch, L. T.; Scherpenzeel, A.
Year 2016
Access date 01.06.2016
Abstract
One of the greatest threats to the accuracy of estimates from panel data is the occurrence of attrition of participants over the panel lifetime. Fortunately, panel recruitment interviews often provide rich sources of data that allow identifying the type of background characteristics affected most seriously by attrition. However, in practice the degree of attrition is seldom studied on these rich data sets, possibly because it is difficult to synthesize the degree of attrition across many auxiliary covariates. In this study, we address this shortcoming while studying attrition in the Dutch Liss online panel using the rich set of auxiliary variables available from the panel recruitment interviews. We estimated panel representativeness for each month of seven years of panel lifetime (2008-2015) using so-called representativeness (R-) indicators. The favorable feature of R-indicators is that they allow quantifying the degree of selectivity in a sample at a given point in time based on the information encoded in theauxiliary data. In doing so, we could include nearly forty variables in estimating representativeness,including respondents’ health, economic status, personality, political attitudes, and survey attitudes, besides standard socio-demographics. The time-series of R-indicators that resulted from this project offers a unique view into the evolvement of panel representativeness and attrition. We found that attrition occurred in the Liss panel in two stages. First, there was an onset loss in representatives that occurred already at the first panel wave. Second, representativeness decreased across two and a half years of panel lifetime and subsequently stabilized. In our presentation, we show how the general losscan be split up into the contributions of the variable groups. We also evaluate the impact that a stratified and a random refreshment sample had on panel representativeness.
Access/Direct link Conference Homepage (abstract)
Year of publication2016
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Klausch, L. T. (18)
- Mixed Mode Research: Issues in Design and Analysis; 2016; Hox, J.; De Leeuw, E. D.; Klausch, L. T.
- A look into the challenges of mixed-mode surveys; 2016; Klausch, L. T.
- Tracking the Representativeness of an Online Panel Over Time ; 2016; Klausch, L. T.; Scherpenzeel, A.
- Selection error in single- and mixed mode surveys of the Dutch general population; 2015; Hox, J., Klausch, L. T., Schouten, B.
- Evaluating mixed-mode redesign strategies against benchmark surveys: the case of the Crime Victimization...; 2014; Klausch, L. T., Hox, J., Schouten, B.
- The use of within-subject experiments for estimating measurement effects in mixed-mode surveys ; 2014; Klausch, L. T., Schouten, B., Hox, J.
- Pret met panels [Fun online]; 2013; Roberts, A., de Leeuw, E. D., Hox, J., Klausch, L. T., de Jongh, A.
- Leuker kunnen wij het wel maken. Online vragenlijst design: standaard matrix of scrollmatrix (We can...; 2013; Roberts, A., de Leeuw, E. D., Hox, J., Klausch, L. T., de Jongh, A.
- Measurement Effects of Survey Mode on the Equivalence of Attitudinal Rating Scale Questions; 2013; Klausch, L. T., Hox, J., Hox, J., Schouten, B.
- Estimating Measurement Effects of Survey Modes From Between and Within Subject Designs; 2013; Klausch, L. T., Hox, J., Schouten, B.
- Design of Web Questionnaires: Matrix Questions or Single Question Formats ; 2012; de Leeuw, E. D., Hox, J., Klausch, L. T., Roberts, A., de Jongh, A.
- Disentangling Mode-Specific Selection and Measurement Bias in Social Surveys; 2012; Buelens, B., van der Laan, J., Schouten, B., Klausch, L. T., van der Brakel, J., Burger, J.
- Assessing Measurement Equivalence and Bias of Questions in Mixed-mode Surveys Under Controlled Sample...; 2012; Klausch, L. T., Hox, J., Schouten, B.
- The Representativity of Web Surveys of the General Population compared to Traditional Modes and Mixed...; 2012; Klausch, L. T., Schouten, B., Hox, J.
- Matrix vs. Single Question Formats in Web Surveys: Results from a large scale experiment; 2012; Klausch, L. T., de Leeuw, E. D., Hox, J., de Jongh, A., Roberts , A.
- Disentangling relative mode effects for the web survey mode in the Safety Monitor; 2011; Schouten, B., van de Brakel, J., Buelens, B., Klausch, L. T., van der Laan, J.
- Respondent Characteristics as Explanations for Uninformative Survey Response: Sources of Nondifferentiation...; 2011; Van Meurs, L., Klausch, L. T., Schoenbach, K.
- Testing between-mode measurement invariance under controlled selectivity conditions; 2011; Klausch, L. T.