Web Survey Bibliography
RRelevance and research question
The concept of paradata, also called process data, was first introduced in the survey research community by Mick Couper in 1998 and referred primarily to computer assisted interviewing in general. In 2001 Jeavons introduced the concept of paradata for web surveys at an Esomar event in Barcelona. Paradata are data about the process of data collection and come primarily from the system used in collecting the data.
Paradata have been collected since the beginning of computer administered interviewing and used primarily by survey managers and field supervisors to monitor the progress and quality of the data collection. Since then there have been many usages of paradata.
In this paper I create a new taxonomy of paradata for web surveys.
Methods and data
There are many possible types of paradata that can be collected for web surveys and computer assisted self interviewing (Casi).
Paradata for web surveys and Casi can be classified as
a) device type and
b) questionnaire navigation paradata.
In the first case it is possible to know what device have been used to fill out a survey (e.g.a smart phone or a desktop computer) the location of the device ( by using either the I.P. address or GPS information) and other parameters such as screen resolution and language of the operating system.
Questionnaire navigation paradata capture all sort of movements within the questionnaire, change of answers, time spent per question, mouse clicks and other non questionnaire related data such as activation of error messages, prompts, or clicks on help/FAQ within the survey.
For each paradata types I provide examples of its usage in terms of quality improvements in the questionnaire or data collection, and in terms of understanding of the self administered response process.
This seems to be the first attempt to create a taxonomy of paradata for web surveys and computer assisted self-administered interviews (Casi). The paper will result in a book chapter already accepted for publication and presented as preview at GOR.
GOR Homepage (abstract) / (full text)
Web Survey Bibliography - Measurement (1963)
- Break-off and attrition in the GIP amongst technologically experienced and inexperienced participants...; 2013; Blom, A. G., Bossert, D., Clark, V., Funke, F., Gebhard, F., Holthausen, A., Krieger, U., Wachenfeld...
- Nonresponse and Nonresponse Bias in a Probability-Based Internet Panel; 2013; Blom, A. G., Bossert, D., Funke, F., Gebhard, F., Holthausen, A., Krieger, U.
- Rewards - Money for Nothing?; 2013; Cape, P. J., Martin, P.
- Effects of incentive reduction after a series of higher incentive waves in a probability-based online...; 2013; Struminskaya, B., Kaczmirek, L., Schaurer, I., Bandilla, W.
- Timing of Nonparticipation in an Online Panel: The effect of incentive strategies; 2013; Douhou, S., Scherpenzeel, A.
- Web coverage in the UK and its potential impact on general population web surveys; 2013; Callegaro, M.
- Surveys on Mobile Devices: Opportunities and Challenges; 2013; Couper, M. P.
- Measurement effects in mixed-mode panel surveys; 2013; Lugtig, P. J.
- Life history calendars - a viable method for web-based data collection?; 2013; Glasner, T., van der Vaart, W.
- Measurement issues in web surveys: An overview of opportunities and challenges; 2013; Calderwood, L.
- Participation and engagement in web surveys of the general population: An overview of challenges and...; 2013; Roberts, C.
- Using Web Survey Panels to Estimate Population Characteristics: A Comparison of Alternative Approaches...; 2013; Rivers, D.
- The ONS Beyond 2011 Programme & possible implications for social surveys; 2013; Morris, L.
- Issues of Coverage and Sampling in Web Surveys for the General Population: An Overview; 2013; Lynn, P.
- Use of a Social Networking Web Site for Recruiting Canadian Youth for Medical Research; 2013; Chu, J. L., Snider, C. E.
- Comparison of web-based versus paper-and-pencil administration of a humor survey; 2013; Wang, C.-C., Cheng, C.-L.;, Liu, K.-S., Cheng, Y.-Y.
- The Design of Grids in Web Surveys; 2013; Couper, M. P., Tourangeau, R., Conrad, F. G., Zhang, C.
- The smartphone in survey research: experiments for time use data; 2013; Fernee, H., Scherpenzeel, A.
- Survey Research; 2013; Abbott, M. L., McKinney, J.
- Understanding and Applying Research Design; 2013; Abbott, M. L., McKinney, J.
- Large-Scale Analysis and Testing; 2013; Cao, M., Zhang, Q.
- The Science of Web Surveys; 2013; Tourangeau, R., Conrad, F. G., Couper, M. P.
- True experimental data collection on the Internet; 2013; Reips, U. -D., Krantz, J. H.
- Virtual Research Methods; 2013; Hine, C.
- Informed Consent for Web Paradata Use; 2013; Couper, M. P., Singer, E.
- Measurement invariance and quality of composite scores in a face-to-face and a web survey; 2013; Revilla, M.
- 'Ready to complete the survey on Facebook': Web 2.0 as a research tool in business studies; 2013; Gregori, A., Baltar, F.
- Surveying “difficult-to-sample” backpackers through Facebook? Employing a mixed-mode dual...; 2013; Morris Paris, C.
- Online Instruments, Data Collection, and Electronic Measurements: Organizational Advancements; 2013; Bocarnea, M. C., Reynolds, R. A., Baker, J. D.
- The equivalence of Internet versus paper-based surveys in IT/IS adoption research in collectivistic...; 2013; Fang, J., Wen, C., Prybutok, V.
- Examining the Gender Effects of Different Incentive Amounts in a Web Survey; 2013; Boulianne, S. J.
- How Do Lotteries and Study Results Influence Response Behavior in Online Panels?; 2013; Goeritz, A., Luthe, S. C.
- Mode Effects in Free-list Elicitation: Comparing Oral, Written, and Web-based Data Collection; 2013; Gravlee, C. C., Bernard, H. R., R., Jacobsohn, A., R.Maxwell, C. R.
- The effect of short formative diagnostic web quizzes with minimal feedback; 2013; Baelter, O., Enstroem, E., Klingenberg, B.
- Sample composition discrepancies in different stages of a probability-based online panel; 2013; Bosnjak, M., Haas, I., Galesic, M., Kaczmirek, L., Bandilla, W., Couper, M. P.
- A comparison of data quality and practicality of online versus postal questionnaires in a sample of...; 2013; King, M. T., Butow, P., Olver, I., Smith, A. B.
- Up Means Good: The Impact of Screen Position on Evaluative Ratings in Web Surveys.; 2013; Tourangeau, R., Conrad, F. G., Couper, M. P.
- Worldwide online research spending; 2012
- What we can learn from unintentional mobile respondents; 2012; Peterson, G.
- Using paradata to explore item-level response times in surveys; 2012; Couper, M. P., Kreuter, F.
- Using multivariate statistics, 6th Edition; 2012; Tabachnick, B. G., Fidell, L. S.
- Unintentional mobile respondents; 2012; Peterson, G.
- Tracking preference expression (DNT); 2012
- The smartphone psychology manifesto; 2012; Miller, G.
- The rise of the "connected viewer"; 2012; Smith, A., Boyles, J. L.
- The practice of social research; 2012; Babbie, E. R.
- The integration of facebook into class management: an exploratory study; 2012; Chou, P. N.
- The effects of item saliency and question design on measurement error in a self-administered survey; 2012; Stern, M. J., Smyth, J. D., Mendez, J.
- The cross platform report. Q2 -2012 - US; 2012
- Speed (necessarily) doesn’t kill: A new way to detect survey satisficing; 2012; Garland, P. et al.