Web Survey Bibliography
Because of its interactive character the web may promote more accurate survey data than do other modes. One way that interactivity can increase data quality is by providing feedback to respondents about their answers. For example, questions known as tally or constant sum items require that multiple answers sum to a fixed total, e.g. 24 hours or 100 percent; for these items a web questionnaire can inform the respondent about whether or not their individual answers add-up to the target value. Designers can provide this feedback when the respondent submits the entire set of responses or in a running tally that is incremented as the respondent enters each component answer. We report three experiments that investigate how this kind of feedback aects the quality of answers for tally items. In experiment 1 we found that if the computer displays a running tally this increased the number of totals equal to the target sum (100% of a respondents internet usage) relative to feedback that is delayed until after the total is submitted, which in turn led to more totals equaling the target than no feedback. While promising, this result really concerns the number of well-formed answers (i.e., those equal to the target) which is not necessarily the same as the number of accurate answers because some respondents may produce a well-formed answer by adjusting one or two component answers to make the total add to the target without improving the accuracy of the components. So in experiments 2 and 3 we asked whether feedback about the total also led to more accurate data. In experiment 2, respondents reported how long it had taken them to complete each section of the questionnaire they were just nishing and we compared this to their actual times; the difference between their self-reports and the server-recorded durations was smaller when a running tally was displayed than when it was not. In experiment 3 we asked respondents to report how much time they had spent on each of several activities in the previous day and compared their time use estimates to published population estimates. Again, the running tally led to smaller dierences between the self- and published reports than when this feedback was not provided. Taken together, the studies suggest that the interactivity of the web can improve both the form and the accuracy of answers for this type of item. It is not possible to provide feedback like this with self-administered paper questionnaires and it is not easy to do so in interviews so this may be a case where web administration adds clear value over other modes of data collection.
Conference homepage (abstract)
Web Survey Bibliography - Online measurement (772)
- Rewards - Money for Nothing?; 2013; Cape, P. J., Martin, P.
- Web coverage in the UK and its potential impact on general population web surveys; 2013; Callegaro, M.
- Life history calendars - a viable method for web-based data collection?; 2013; Glasner, T., van der Vaart, W.
- Measurement issues in web surveys: An overview of opportunities and challenges; 2013; Calderwood, L.
- Issues of Coverage and Sampling in Web Surveys for the General Population: An Overview; 2013; Lynn, P.
- The Design of Grids in Web Surveys; 2013; Couper, M. P., Tourangeau, R., Conrad, F. G., Zhang, C.
- Survey Research; 2013; Abbott, M. L., McKinney, J.
- Understanding and Applying Research Design; 2013; Abbott, M. L., McKinney, J.
- Large-Scale Analysis and Testing; 2013; Cao, M., Zhang, Q.
- Virtual Research Methods; 2013; Hine, C.
- Informed Consent for Web Paradata Use; 2013; Couper, M. P., Singer, E.
- Measurement invariance and quality of composite scores in a face-to-face and a web survey; 2013; Revilla, M.
- Surveying “difficult-to-sample” backpackers through Facebook? Employing a mixed-mode dual...; 2013; Morris Paris, C.
- Online Instruments, Data Collection, and Electronic Measurements: Organizational Advancements; 2013; Bocarnea, M. C., Reynolds, R. A., Baker, J. D.
- Examining the Gender Effects of Different Incentive Amounts in a Web Survey; 2013; Boulianne, S. J.
- Tracking preference expression (DNT); 2012
- The rise of the "connected viewer"; 2012; Smith, A., Boyles, J. L.
- The practice of social research; 2012; Babbie, E. R.
- The integration of facebook into class management: an exploratory study; 2012; Chou, P. N.
- Sensitive topics in PC Web and mobile web surveys: Is there a difference?; 2012; Mavletova, A. M., Couper, M. P.
- Selection bias of internet panel surveys: A comparison with a paper-based survey and national governmental...; 2012; Tsuboi, S. et al.
- Screenwise panel: Frequently Asked Questions; 2012
- Research company spotlight - Mobile surveys; 2012
- Redeveloping the research section of Meningitis UK's website — A case study report; 2012; Witt, J. et al.
- Participation of mobile users in traditional online studies; 2012; Jue, A.
- Online survey statistics for the mobile future. Updated with Q3 2012 data; 2012
- Metering mobile usage. Insights from global Arbitron mobile trends panel; 2012; Verkasalo, H.
- Media tracker; 2012
- Measuring the quality of governmental websites in a controlled versus an online setting with the ‘...; 2012; Elling, S. et al.
- Internet use in households and by individual in 2012. Eurostat Statistics in Focus 50/2012; 2012; Seybert, H.
- Guide to social science data preparation. Best practice throughout the data life cycle; 2012
- Google et Médiamétrie créent une audience bimédia; 2012; Gonzales, P.
- Flowing with the mainstream. Is mobile market research finally living up to the hype?; 2012; Townsend, L.
- Online Surveys 2.0; 2012; Elferink, R.
- The Impact of Academic Sponsorship on Online Survey Dropout Rates; 2012; Allen, P. J., Roberts, L. D.
- Snowball Sampling in Online Social Networks; 2012; Raissi, M., Ackland, R.
- Data quality of questions sensitive to social-desirability bias in web surveys; 2012; Lozar Manfreda, K., Zajc, N., Berzelak, N., Vehovar, V.
- Online Questionnaires: Development of ‘basic requirements’; 2012; Tries, S., Blanke, K.
- Efficacy of a health-related Facebook social network site on health-seeking behaviors; 2012; Woolley, P., Peterson, M.
- Paradata; 2012; Kreuter, F.
- Modes of Data Collection; 2012; Tourangeau, R.
- Measure the response burden in the Swedish Intrastat system; 2012; Weideskog, F.
- Mode and non-response effects and their treatment; 2012; Chrysanthopoulos, S., Georgostathi, A.
- What can be said about quality in the Central Population Register based on a self-completion survey...; 2012; Falnes-Dalheim, E., Pedersen, H. E.
- Improving the quality of complex surveys: The case of the EU Labour Force Survey ; 2012; van der Valk, J.
- The re-engineering of the Structural Earnings survey process: Mixed - Mode data collection and new E...; 2012; Cardinaleschi, S., De Santis, S., Rocci, F., Spinelli, V.
- Between demand and reality: Ensuring efficiency and quality in pretesting questionnaires; 2012; Sattelberger, S., Blanke, K.
- How to provide high data quality in online-questionnaires: Setting guidelines in design; 2012; Tries, S., Nebel, S., Blanke, K.
- Boosting Web pick-up Rates by referring to Compliance Principles ; 2012; Falnes-Dalheim, E., Haraldsen, G., Sundvoll, A.
- Ebook readings jumps, print book reading declines; 2012; Rainie, L., Duggan, M.

