Web Survey Bibliography
One of the advantages of web surveys is the availability of simple and effective collection of paradata, i.e. data about the process of data collection. Widespread availability of client-side technologies in modern web browsers offers a range of different types of these data. Their utilization and analysis can significantly contribute to understanding the response process and thus identification of potential data quality problems at the level of individual respondents and the survey as a whole. In this paper we scrutinize the use of different possibilities of automatically collected paradata for evaluation of data quality in web surveys. We implemented an advanced paradata collection solution that offers a number of different paradata related to: time (total and first-visit page times, estimated answering times at the question level), questionnaire routing (tracking across pages, returns in the questionnaire), notifications to respondents (frequency and location of item nonresponse and quality check reminders), indications of response-order effects across several questions, multitasking during responding and others. We analyze the relations between these paradata, questionnaire characteristics and response quality indicators across a number of surveys conducted within our research organization. In addition, a dedicated web questionnaire with different question types, logical controls and other features for data quality estimation was conducted. The paper begins with a discussion of technological, methodological and ethical aspects of potentials and problems of using advanced automatically collected paradata in web surveys. It then focuses on analysis of empirical data and presents the power of paradata for understanding the response process and estimation of measurement data quality. Finally, possible future developments of web survey paradata collection and uses are outlined.
Conference Homepage (abstract)
Web survey bibliography - Vehovar, V. (46)
- Overview: Online Surveys; 2017; Vehovar, V.; Lozar Manfreda, K.
- Introduction Breakoffs, Questionnaire Breakoffs and Web Questionnaire Length: A Metastudy ; 2016; Cehovin, G.; Vehovar, V.
- Investigating respondent multitasking in web surveys using paradata; 2016; Sendelbah, A.; Vehovar, V.; Slavec, A.; Petrovcic, A.
- Identifying and correcting question-wording problems: the case of Wageindicator; 2015; Slavec, A., Vehovar, V., Tijdens, K. G.
- e-Social Science Perspective on Survey Process: Towards an Integrated Web Questionnaire Development...; 2015; Vehovar, V., Petrovcic, A., Slavec, A.
- Questionnaire length and breakoffs in web surveys: a meta study; 2014; Vehovar, V., Cehovin, G.
- WebSM Study: Overview of Features and Pricing of Software Packages in 2014; 2014; Vehovar, V., Cehovin, G.
- WebSM Study: Survey Software in 2014; 2014; Vehovar, V., Cehovin, G., Mocnik, A.
- Data quality of questions sensitive to social-desirability bias in web surveys; 2012; Lozar Manfreda, K., Zajc, N., Berzelak, N., Vehovar, V.
- WebSM Study: Survey software features overview ; 2012; Vehovar, V., Cehovin, G., Kavcic, L., Lenar, J.
- Costs and Errors in Fixed and Mobile Phone Surveys; 2012; Vehovar, V., Slavec, A., Berzelak, N.
- Web Survey Software; 2012; Berzelak, N., Vehovar, V., Slavec, A.
- Surveying general population: What types of experiments are further needed?; 2012; Vehovar, V., Berzelak, N.
- Web panels in Slovenia; 2012; Lenar, J., Vehovar, V.
- Web survey software; 2011; Slavec, A., Berzelak, N., Vehovar, V.
- Web Survey Process within the Concept of eSocial Sciences; 2011; Vehovar, V.
- Optimization of dual frame telephone survey designs; 2011; Slavec, A., Vehovar, V.
- Comments on the paper - Geetha Garib: Perceived diversity among employees; 2011; Vehovar, V.
- Nonresponse in Web Surveys ; 2011; Lozar Manfreda, K., Berzelak, N., Vehovar, V.
- Cost-Error Optimization Model for Mixed-Mode Surveys; 2009; Vehovar, V., Berzelak, N., Lozar Manfreda, K.
- Preference for Mobile Interview Surveys? Interplay of costs, errors and biases; 2009; Vehovar, V., Slavec, A.
- National readership surveys: Moving from probability face-to-face surveys to Internet panels; 2009; Vehovar, V., Slavec, A., Petric, I., Sargac, M.
- Empirical Evaluation of Web Survey Software Tools: Powerful or Friendly?; 2009; Vehovar, V., Berzelak, N., Lozar Manfreda, K., Horvat, T., Debevc, M.
- Optimising survey costs in mixed mode environment; 2009; Vehovar, V., Berzelak, N., Lozar Manfreda, K., Belak, E.
- Nonresponse Bias in Surveys; 2009; Bethlehem, J., Vehovar, V., Stoop, I., Schouten, B., Shlomo, N., Skinner, C., Montaquila, J.
- "Mobile phone surveys in mixed mode environment: Balancing costs and errors"; 2009; Vehovar, V.
- Mobile phone surveys in mixed mode environment; 2009; Vehovar, V.
- Probabilistic methods in surveys and offical statistics; 2008; Vehovar, V., Zaletel, M., Seljak, R.
- Internet surveys; 2008; Lozar Manfreda, K., Vehovar, V.
- What Can We Achieve With 5 Euros? Optimization of Survey Data Quality Using Mixed-Mode Approaches; 2008; Berzelak, N., Vehovar, V., Lozar Manfreda, K.
- Measuring ties on online forums; 2008; Ziberna, A., Vehovar, V., Jakulin, A.
- Nonresponse in web surveys within the context of survey errors and survey costs; 2008; Berzelak, N., Lozar Manfreda, K., Vehovar, V.
- Integration of the web into survey data collection: Balancing costs and errors; 2008; Vehovar, V., Berzelak, N., Lozar Manfreda, K.
- Optimization of costs and errors in mixed-mode surveys; 2008; Vehovar, V., Berzelak, N., Lozar Manfreda, K.
- Overview: Online Surveys; 2008; Vehovar, V., Lozar Manfreda, K.
- Measuring ego-centered social networks on the web: Questionnaire design issues ; 2008; Vehovar, V., Lozar Manfreda, K., Koren, G., Hlebec, V.
- The Impact of Cognitive and Computer Skills on Data Quality in Computer Assisted Self Administered Questionnaires...; 2008; Brecko, B. N., Vehovar, V.
- Internet surveys; 2008; Vehovar, V., Lozar Manfreda, K., Koren, G.
- The influence of mobile telephones on telephone surveys; 2008; Kuusela, V., Callegaro, M., Vehovar, V.
- Collecting Data on Ego-Centered Social Networks on the Web: Methodological Issues; 2004; Lozar Manfreda, K., Vehovar, V., Hlebec, V.
- Mode Effect in Web Surveys; 2002; Vehovar, V., Lozar Manfreda, K.
- Nonresponse in Web Surveys; 2002; Vehovar, V., Lozar Manfreda, K., , Batagelj, Z.
- Virtual Selves and Web Surveys; 2001; Lozar Manfreda, K., Couper, M. P., Vohar, M., Rivas, S., Vehovar, V.
- Nonresponse in Web Surveys; 1999; Vehovar, V.
- Internet v Sloveniji - Projekt RIS 1996-1998.; 1998; Vehovar, V.
- Handling "Don't Know" Survey Responses: The Case of the Slovenian Plebiscite; 1995; Rubin, D. B.; Vehovar, V.; Hal, S. S.