Web Survey Bibliography
In the last six years I have led projects aimed at developing software that learns how to code open-ended survey data from data manually coded by humans. These projects have led to the development of software now in operation at the Customer Satisfaction division of a large international banking group, and now integrated into a major software platform for the management of open-ended survey data. This software, which can code data at a rate of tens of�thousands of responses per hour, is the result of contributions from different fields of computer science, including Information Retrieval, Machine Learning, Computational Linguistics, and Opinion Mining. In this talk I will discuss the basic philosophy underlying this software, I will present the results of experiments we have run on several datasets of respondent data in which we compare the accuracy of the software against the accuracy of human coders, and I will argue for a notion of "accuracy" defined in terms of inter-coder agreement rates. Finally, I will discuss the kind of characteristics that make a survey more or less amenable to automated coding by means of our system.
Homepage (abstract)/(presentation)
Web Survey Bibliography - Italy (80)
- Sampling, Channels, and Contact Strategies in Internet Survey; 2013; Macrì, E., Tessitore, C.
- Norme di qualita' Assirm (Assirm quality rules]; 2012
- Social research in online context: methodological reflections on web surveys from a case study; 2012; Pandolfini, V.
- The re-engineering of the Structural Earnings survey process: Mixed - Mode data collection and new E...; 2012; Cardinaleschi, S., De Santis, S., Rocci, F., Spinelli, V.
- Survey Data Collection and Integration; 2012; Davino, C., Fabbris, L.
- Online Data Collection in the Agro-Food Sector; 2012; Biffignandi, S., Artaz, R.
- Mobile Survey Participation Rates in Commercial Market Research: A Meta-Analysis; 2012; Bosnjak, M., Poggio, T., Becker, K. R., Funke, F., Wachenfeld, A., Fischer, B.
- Panel retention rate and data quality: experimental results drawing on Reciprocity design; 2012; Biffignandi, S., Artaz, R.
- Web Surveys: Methodological Problems and Research Perspectives; 2012; Biffignandi, S., Bethlehem, J.
- About Web Surveys ; 2012; Bethlehem, J., Biffignandi, S.
- Errors in Web Surveys; 2012; Bethlehem, J., Biffignandi, S.
- Sampling for Web Surveys.; 2012; Bethlehem, J., Biffignandi, S.
- A Generalized System for Aided Development and Monitoring of Web Surveys; 2011; Torelli, R.
- Using survey data collection as a tool for improving the survey process; 2011; Biffignandi, S., Perani, G., Laureti, A.
- The Main Innovations of Data Editing and Imputation for the 2010 Italian Agricultural Census ; 2011; Bianchi, G., Lipsi, R. M., Ruocco, G., Salvatore, M. A.
- Facebook sampling methods: some methodological proposals; 2011; Macrì, E., Tessitore, C.
- Errors within web-based surveys: a comparison between two different tools for the analysis of tourist...; 2011; Polizzi, G., Oliveri, A. M.
- Applying maximum entropy weighting to on line panel data collection; 2011; Bianchi, A., Biffignandi, S., Hartmann, E., Sekhon, J.
- Use of new technologies in social research: Self-administered mobile surveys; 2011; Bosnjak, M.
- Internet Survey Methodology: Recent Trends and Developments ; 2011; Biffignandi, S.
- Modeling non-sampling errors and participation in Web surveys; 2010; Biffignandi, S.
- Influence of Outliers on Some Multiple Imputation Methods; 2010; Quintano, C., Castellano, R., Rocca, A.
- L’uso di Internet nella ricerca sociale: vantaggi e svantaggi di una web survey; 2010; Pandolfini, V.
- A Web-Based Versus Paper Questionnaire on Alcohol and Tobacco in Adolescents; 2010; Lygidakis, C., Rigon, S., Cambiaso, S., Bottoli, E., Cuozzo, F., Bonetti, S., Della Bella, C., Marzo...
- Web-based macroseismic survey in Italy: method validation and results; 2010; Sbarra P., Tosi, P., De Rubeis, V.
- Web-based versus paper-based data collection for the evaluation of teaching activity: empirical evidence...; 2010; Lalla, M., Ferrari, D.
- Young people, the Internet and Political Participation: Findings of a web survey in Italy, Spain and...; 2009; Calenda, D., Meijer, A.
- Web based macroseismic survey: fast information exchange and elaboration of seismic intensity effects...; 2009; De Rubeis, V., Sbarra P., Sorrentino, D., Tosi, P.
- Factors Contributing to Participation in Web‐based Surveys among Italian University Graduates; 2009; Cimini, C., Girottu, C., Gasperoni, G.
- Integration of different data collection techniques using the propensity score; 2009; Camillo, F., Conti, V., Ghiselli, S.
- Modelling online survey participation among Italian university graduates ; 2009; Cimini, C., Girotti, C., Gasperoni, G.
- Coverage rates of mobile telephones and the Internet in Italy ; 2009; Fabbris, L., Gorelli, S.
- An experiment on the effects of non-response reweighting on estimators' precision in a web survey; 2009; Fabrizi, E., Biffignandi, S., Toninelli, D.
- Anticipated estimation from a panel Web survey: the case of the presence of tourists in the Province...; 2009; Scaffai, G., Pratesi, M.
- The Electronic Questionnaire Experience in Business Surveys: mode effects on quality and on response...; 2009; Biffignandi, S., Siesto, G., Zeli, A.
- The new IT environment for the Italian consumer price survey; 2009; Giannini, R., Polidoro, F., Sgamba, A. M., Silipo, M., Spagnuolo, F., Virgillito, A.
- Is data collection via web a valid methodology?; 2008; Otero, P.
- Machines that Learn how to Code Open-Ended Survey Data: Underlying Principles, Experimental Data, and...; 2008; Sebastiani, F.
- Avoiding Massive Automated Voting in Internet Polls ; 2008; Basso, A., Miraglia, M.
- Calibration and propensity score weighting in web surveys; 2007; Fabrizi, E., Biffignandi, S.
- The Transition from University to Work: Web Survey Process Quality; 2006; Quintano, C., Castellano, R., D'Agostino, A.
- Response Order Effects in International Online Surveys; 2006; Thomas, R. K., Greenfield, S., Bremer, J.
- Telephone and Web surveys: a study of the marginal effect mode; 2006; D'Agostino, A., Quintano, C., Castellano, R.
- Web survey on transition from university to work: measuring the marginal effect mode; 2006; D'Agostino, A., Quintano, C., Castellano, R.
- Trust, Identity, and the Effects of Voting Technologies on Voting Behavior; 2005; Oostveen, A. M., Besselaar, P.
- Web surveys: inference using weighting and imputation in the survey on graduates; 2005; Biffignandi, S., Fabrizi, E., Pratesi, M., Salvati, N.
- Web surveys: inference using weighting and imputation in the survey on graduates; 2005; Biffignandi, S., Fabrizi, E., Pratesi, M., Salvati, N.
- Response Rates and Data Quality Issues in a Mixed Mode Survey About the Diffusion of the E-Business...; 2005; Biffignandi, S., Fabrizi, E., Zucchi, F., Toninelli, D.
- The Transition from University toWork: Web Survey Process Quality; 2005; Quintano, C., Castellano, R., D'Agostino, A.
- Personality of people using Chat: An on-line research; 2005; Anolli, L., Villani, D., Riva, G.
