Web Survey Bibliography
Online panels are at present one of fastest growing data collection modes for market and opinion research (AAPOR report on online panels). With the use of online panels, concern grew about the recruitment of panel members, and especially the emergence of large nonprobability panels. The combination of self-selection and incentives, both important characteristics of non-probability based internet surveys, and the increased use of such non-probability based internet panels, lead to an increased fear of the emergence of ‘professional respondents’ (e.g. Comley, 2005) and the negative consequences of this for data quality. So far, there are very few empirical studies into this topic. The goal of this study is (1) to investigate whether ‘professional’ respondents can be distinguished in online panels using latent class analysis, (2) describe who the professional are and provide a demographical and psychographical profile, and (3) investigate whether there is a difference in the quality of the data provided by these ‘professional’ respondents and the other respondents in the panel. In our study, we analyzed a unique data set of the NOPVO (Nederlands Online Panel Vergelijkings Onderzoek; Vonk et al, 2006) that includes 19 large Dutch online panels, which together capture 90% of the respondents to online market research in the Netherlands. A latent class analysis showed that four types of respondents can be distinguished, ranging from the ‘professional’ respondent to the ‘altruistic-voluntary’ respondent. Also, different respondent types can be clearly characterized using demographical and psychographical variables. The ultimate question is whether the existence of professional respondents is a threat to the data quality of internet panels. Do professional respondents satisfice more, do they take more short-cuts? Indeed, small differences in data quality can be detected between the groups. However, these differences disappear when controlling for socio-demographic variables.
Conference Homepage (abstract)
Web survey bibliography - De Leeuw, E. D. (27)
- Estimating the Impact of Measurement Differences Introduced by Efforts to Reach a Balanced Response...; 2017; Kappelhof, J. W. S.; De Leeuw, E. D.
- Mixed Mode Research: Issues in Design and Analysis; 2016; Hox, J.; De Leeuw, E. D.; Klausch, L. T.
- Dropouts in Longitudinal Surveys; 2016; Lugtig, P. J.; De Leeuw, E. D.
- Internet Panels, Professional Respondents, and Data Quality; 2015; Matthijsse, S.; De Leeuw, E. D.; Hox, J.
- Mode System Effects in an Online Panel Study: Comparing a Probability-based Online Panel with two Face...; 2015; Struminskaya, B.; De Leeuw, E. D.; Kaczmirek, L.
- Pret met panels [Fun online]; 2013; Roberts, A., de Leeuw, E. D., Hox, J., Klausch, L. T., de Jongh, A.
- Leuker kunnen wij het wel maken. Online vragenlijst design: standaard matrix of scrollmatrix (We can...; 2013; Roberts, A., de Leeuw, E. D., Hox, J., Klausch, L. T., de Jongh, A.
- Internet Coverage and Coverage Bias in Europe: Developments Across Countries and Over Time; 2013; Mohorko, A., de Leeuw, E. D.,Hox, J.
- Random versus Systematic Error in a Mixed Mode Online-Telephone Survey; 2013; Hox, J., Scherpenzeel, A., Boeve, A., Boeve, A., de Leeuw, E. D.
- Mode Effects in Mixed-Mode Surveys: Prevention, Diagnostics, and Adjustment 1; 2013; de Leeuw, E. D., Dillman, D. A., Schouten, B.
- Does one really know?: Avoiding noninformative answers in a reliable way.; 2013; de Leeuw, E. D., Boevee, A., Hox, J.
- Counting and Measuring Online: The Quality of Internet Surveys; 2012; De Leeuw, E. D.
- Design of Web Questionnaires: Matrix Questions or Single Question Formats ; 2012; de Leeuw, E. D., Hox, J., Klausch, L. T., Roberts, A., de Jongh, A.
- Professional Respondents in Internet Panels: Who are They and What Do They Do to Our Data?; 2012; de Leeuw, E. D., Matthijsse, S.
- Question or Mode Effects in Mixed-Mode surveys: A Cross-cultural study in the Netherlands, Germany,...; 2012; de Leeuw, E. D., Nicolaas, G., Campanelli, P., Hox, J.
- Matrix vs. Single Question Formats in Web Surveys: Results from a large scale experiment; 2012; Klausch, L. T., de Leeuw, E. D., Hox, J., de Jongh, A., Roberts , A.
- Flexibility of Web Surveys: Probing 'do-not-know' over the Phone and on the Web; 2011; Hox, J., de Leeuw, E. D.
- Mode Effect or Question Wording? Measurement Error in Mixed Mode Surveys; 2011; de Leeuw, E. D., Hox, J., Scherpenzeel, A.
- Measurement Error in Mixed Mode Surveys: Mode or Question Format?; 2011; de Leeuw, E. D., Hox, J.
- Online Interviewing through Access Panel: Quantity and Quality Assurance; 2009; Petric, I., Appel, M., de Leeuw, E. D.
- Reducing Measurement Errors in Surveys; 2009; De Leeuw, E. D.
- Missing data; 2008; de Leeuw, E. D., Hox, J.
- The influence of advance letters on response in telephone surveys; 2007; de Leeuw, E. D., Callegaro, M., Hox, J., Korendijk, E., Lensvelt-Mulders, G. J.
- Have Telephone Surveys a Future in the 21-th century?; 2002; de Leeuw, E. D., Lepkowski, J. M., Kim, S.-W.
- Trends in household survey nonresponse: A longitudinal and international comparison; 2001; de Leeuw, E. D., de Heer, W.
- The effect of computer-assisted interviewing on data quality: A review.; 1995; de Leeuw, E. D., Hox, J., Snijkers, G.
- Data Quality in Mail, Telephone and Face to Face Surveys; 1992; De Leeuw, E. D.