Web Survey Bibliography
Title Panel Online: how important is the recruitment mode ?
Year 2016
Access date 29.04.2016
Presentation PDF (1.02MB)
Abstract
Relevance & Research Question: Non probabilistic online panels are gaining more and more market shares. The 2 main factors are determining this success are the low cost and speed in the data collection. We focalized our research on the the way panellists were recruited: offline through CATI interview or online through banners and advertisements on facebook. Our main question is : Is there any difference between panelists recruited via CATI and panelists recruited online in terms of data quality ?
Methods & Data: For our research we used data collected using our own panel: Opinione.net. This panel was created on January 2011, during the first 4 years the panelists were recruited exclusively offline. In the last years we also started to recruit panelists online. At the time when we’ve carried out the surveys 6674 panelists were subscribed to our panel, 3632 recruited offline, 3042 recruited online. To assess our hypothesis we analysed the data collected by 5 different web surveys carried out on our panel.
To measure the data quality we’ve used several indicators (response time, number of DK, non differentiation index)
Results: Panelists recruited online are generally quicker than the ones recruited offline, in all 5 surveys the length of interview for the web recruited is shorter (significative difference) and 4 times out of 5 the panelists recruited via cati take 20% more time to complete the questionnaire.
Also the non differentiation index shows differences between two groups: panelists recruited via CATI give more differentiated responses (T test significative).
Panelists recruited online are generally younger, high percentage of women and housewives, while panelists recruited via CATI show a greater percentage of pensioners. Panelists recruited via web are more active (significantly higher number of clicked links/day ), have an higher percentage of 'Completed' and a lower percentage of 'Early Screen Out'.
Methods & Data: For our research we used data collected using our own panel: Opinione.net. This panel was created on January 2011, during the first 4 years the panelists were recruited exclusively offline. In the last years we also started to recruit panelists online. At the time when we’ve carried out the surveys 6674 panelists were subscribed to our panel, 3632 recruited offline, 3042 recruited online. To assess our hypothesis we analysed the data collected by 5 different web surveys carried out on our panel.
To measure the data quality we’ve used several indicators (response time, number of DK, non differentiation index)
Results: Panelists recruited online are generally quicker than the ones recruited offline, in all 5 surveys the length of interview for the web recruited is shorter (significative difference) and 4 times out of 5 the panelists recruited via cati take 20% more time to complete the questionnaire.
Also the non differentiation index shows differences between two groups: panelists recruited via CATI give more differentiated responses (T test significative).
Panelists recruited online are generally younger, high percentage of women and housewives, while panelists recruited via CATI show a greater percentage of pensioners. Panelists recruited via web are more active (significantly higher number of clicked links/day ), have an higher percentage of 'Completed' and a lower percentage of 'Early Screen Out'.
Access/Direct link Conference Homepage (presentation)
Year of publication2016
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Italy (57)
- Web Health Monitoring Survey: A New Approach to Enhance the Effectiveness of Telemedicine Systems; 2017; Romano, M. F.; Sardella, M. V.; Alboni, F.
- Web Health Monitoring Survey: A New Approach to Enhance the Effectiveness of Telemedicine Systems ; 2016; Romano, M. F.; Sardella, M. V.; Alboni, F.
- Recommended Practices for the design of business surveys questionnaires; 2016; Macchia, S.
- Cheating in web surveys. Evidence from a split-ballot repeated experiment on knowledge questions on...; 2015; Ladini, R.; Vezzoni, C.
- 640 Current trends in management of high-risk prostate cancer in Europe: Results of a web-based survey...; 2014; Briganti, A., Isbarn, H., Ost, P., Ploussard, G., Sooriakumaran, P., Van Den Bergh, R.C.N., Van Oort...
- The invisible Interviewer: Old and New Methodological Issues in Online Research; 2014; Niero, M.
- The need of and the demand for completing surveys on mobile devices; 2014; Toninelli, D., Revilla, M., Ochoa, C.
- Survey participation via mobile devices in a probability-based online-panel: Prevalence, determinants...; 2014; Poggio, T., Bosnjak, M., Weyandt, K.
- Web-respondent-driven sampling; 2014; Bianchi, A., Biffignandi, S., Artaz, R.
- Prioritisation of alternatives with analytical hierarchy process plus response latency and web survey...; 2014; Barone, S. Errore, A., Lombardo, A.
- Modelling ”don’t know” responses in rating scales; 2014; Manisera, M., Zuccolotto, P.
- How much is shorter CAWI questionnaire VS CATI questionnaire?; 2014; Bartoli, B.
- Online mobile surveys in Italy: coverage and other methodological challenges; 2014; Poggio, T.
- Migraine and pregnancy: an internet survey; 2013; Allais, G. et al.
- The internet user profile of Italian families of patients with rare diseases: a web survey; 2013; Tozzi, A. E., Mingarelli, R., Agricola, E., Gonfiantini, M., Pandolfi, E., Carloni, E., Gesualdo, F.,...
- Web Surveys and Official Statistics: Perspectives and Cases ; 2013; Martelli, B.
- The challenge of a mixed-mode design survey and new IT tools application: the case of the Italian Structure...; 2013; Cardinaleschi, S., De Santis, S., Rocci, F., Spinelli, V.
- The Design of the Online Questionnaire of the Italian Population Census ; 2013; Tininini, L., Virgillito, A.
- The behaviour of respondents while filling in a web questionnaire: the case of the Italian business...; 2013; Masselli, M., Nuccitelli, A.
- A web-based Census of services: an ISTAT evolutionary study ; 2013; Cesaro, A., Palazzi, B., Paterniti, M., Ranaldi, P.
- A web based management system for addressing census complexity: the Italian experience; 2013; Bruno, M., Giacummo, M., Silipo, M., Vaste, G.
- Online Survey on Twitter: A Urological Experience; 2013; Dal Moro, F.
- Web Panel Representativeness; 2013; Bianchi, A., Biffignandi, S.
- Measuring the impact of the Web: Rasch modelling for survey evaluation; 2013; Annoni, P., Weziak-Bialowolska, D., Farhan, H.
- Responsive design for mixed-mode panel data; 2013; Bianchi, A., Biffignandi, S.
- Adjusting for bias in a mixed-mode CAWI survey on University students ; 2013; Clerici, R., Giraldo, A.
- Comparative analysis of data from web and face-to-face surveys. A case study on e-commerce in young...; 2013; Cappello, C., Pellegrino, D.
- The Relation of Survey Topic and Participation Behavior. Analyzing Unit Nonresponse using web-generated...; 2013; Zillmann, D., Schmitz, A., Blossfeld, H. P.
- A walking exercise on a tightrope: trying to balance coverage, probabilistic sampling and the costs...; 2013; Poggio, T.
- Norme di qualita' Assirm (Assirm quality rules]; 2012
- Social research in online context: methodological reflections on web surveys from a case study; 2012; Pandolfini, V.
- Survey Data Collection and Integration; 2012; Davino, C., Fabbris, L.
- Online Data Collection in the Agro-Food Sector; 2012; Biffignandi, S., Artaz, R.
- Mobile Survey Participation Rates in Commercial Market Research: A Meta-Analysis; 2012; Bosnjak, M., Poggio, T., Becker, K. R., Funke, F., Wachenfeld, A., Fischer, B.
- Panel retention rate and data quality: experimental results drawing on Reciprocity design; 2012; Biffignandi, S., Artaz, R.
- Web Surveys: Methodological Problems and Research Perspectives; 2012; Biffignandi, S., Bethlehem, J.
- A Generalized System for Aided Development and Monitoring of Web Surveys; 2011; Torelli, R.
- Using survey data collection as a tool for improving the survey process; 2011; Biffignandi, S., Perani, G., Laureti, A.
- Facebook sampling methods: some methodological proposals; 2011; Macrì, E., Tessitore, C.
- Errors within web-based surveys: a comparison between two different tools for the analysis of tourist...; 2011; Polizzi, G., Oliveri, A. M.
- Use of new technologies in social research: Self-administered mobile surveys; 2011; Bosnjak, M.
- Modeling non-sampling errors and participation in Web surveys; 2010; Biffignandi, S.
- Web-based macroseismic survey in Italy: method validation and results; 2010; Sbarra P., Tosi, P., De Rubeis, V.
- Web-based versus paper-based data collection for the evaluation of teaching activity: empirical evidence...; 2010; Lalla, M., Ferrari, D.
- Web based macroseismic survey: fast information exchange and elaboration of seismic intensity effects...; 2009; De Rubeis, V., Sbarra P., Sorrentino, D., Tosi, P.
- Factors Contributing to Participation in Web‐based Surveys among Italian University Graduates; 2009; Cimini, C., Girottu, C., Gasperoni, G.
- Integration of different data collection techniques using the propensity score; 2009; Camillo, F., Conti, V., Ghiselli, S.
- Modelling online survey participation among Italian university graduates ; 2009; Cimini, C., Girotti, C., Gasperoni, G.
- Coverage rates of mobile telephones and the Internet in Italy ; 2009; Fabbris, L., Gorelli, S.
- An experiment on the effects of non-response reweighting on estimators' precision in a web survey; 2009; Fabrizi, E., Biffignandi, S., Toninelli, D.