Web Survey Bibliography
Because of its interactive character the web may promote more accurate survey data than do other modes. One way that interactivity can increase data quality is by providing feedback to respondents about their answers. For example, questions known as tally or constant sum items require that multiple answers sum to a fixed total, e.g. 24 hours or 100 percent; for these items a web questionnaire can inform the respondent about whether or not their individual answers add-up to the target value. Designers can provide this feedback when the respondent submits the entire set of responses or in a running tally that is incremented as the respondent enters each component answer. We report three experiments that investigate how this kind of feedback aects the quality of answers for tally items. In experiment 1 we found that if the computer displays a running tally this increased the number of totals equal to the target sum (100% of a respondents internet usage) relative to feedback that is delayed until after the total is submitted, which in turn led to more totals equaling the target than no feedback. While promising, this result really concerns the number of well-formed answers (i.e., those equal to the target) which is not necessarily the same as the number of accurate answers because some respondents may produce a well-formed answer by adjusting one or two component answers to make the total add to the target without improving the accuracy of the components. So in experiments 2 and 3 we asked whether feedback about the total also led to more accurate data. In experiment 2, respondents reported how long it had taken them to complete each section of the questionnaire they were just nishing and we compared this to their actual times; the difference between their self-reports and the server-recorded durations was smaller when a running tally was displayed than when it was not. In experiment 3 we asked respondents to report how much time they had spent on each of several activities in the previous day and compared their time use estimates to published population estimates. Again, the running tally led to smaller dierences between the self- and published reports than when this feedback was not provided. Taken together, the studies suggest that the interactivity of the web can improve both the form and the accuracy of answers for this type of item. It is not possible to provide feedback like this with self-administered paper questionnaires and it is not easy to do so in interviews so this may be a case where web administration adds clear value over other modes of data collection.
Conference homepage (abstract)
Web Survey Bibliography - Other (452)
- Do we hear different voices?: Investigating the differences between internet and non-internet users...; 2009; Zhang, C., Callegaro, M., Thomas, M., DiSogra, C.
- The Effect of Email Invitation Customization on Survey Completion Rates in an Internet Panel: A Meta...; 2009; Callegaro, M., Kruse, Y., Thomas, M., Nukulkij, P.
- Panel Conditioning and Attrition in the AP-Yahoo! News Election Panel Study; 2009; Kruse, Y., Callegaro, M., Dennis, J. M., DiSogra, C., Subias, S., Lawrence, M., Tompson, T.
- Recruiting Probability-Based Web Panel Members Using an Address-Based Sample Frame: Results from a Pilot...; 2009; DiSogra, C., Callegaro, M., Hendarwan, E.
- Web Panel Studies of the 2008 Election; 2009; Dennis, J. M., Tompson, T.
- Comparison Study of Early Adopter Attitudes and Online Behavior in Probability and Non-Probability Web...; 2009; Dennis, J. M., Osborn, L., Semans, K.
- Summary of KnowledgePanel® Design; 2009; Dennis, J. M.
- Presentation of a Single Item versus a Grid: Effects on the Vitality and Mental Health Scales of the...; 2009; Callegaro, M., Shand-Lubbers, J., Dennis, J. M.
- Survey Research in Virtual Worlds: Second Life R as a Research Platform; 2009; Hill, C., Dean, E.
- Elderly in an Internet panel, the quality of the data; 2009; Vis, C.
- Computer-Assisted Audio Recording (CARI): Repurposing a Tool for Evaluating Comparative Instrument Design...; 2009; Edwards, B., Hicks, W., Tourangeau, K., Harris-Kojetin, L., Moss, A.
- Do online translated questionnaires result in higher response rates for patient surveys?; 2009; Boyd, J., Davis, A.
- A comparison of two mixed mode designs: cati-capi and web-cati-capi; 2009; Beukenhorst, D., Wetzels, W.
- Comparison between Liss panel (web) and ESS data (face to face); 2009; Revilla, M., Saris, W. E.
- Mobile Phone Surveys in Germany – Response rates and response behaviour; 2009; Hader, S., Schneiderat, G.
- Interviewer voice characteristics and productivity in telephone surveys; 2009; Best, H., Bauer, G., Steinkopf, L.
- Standardized recall aids for online life course surveys; 2009; Glasner, T.
- The impact of forgiving wording and question context on social desirability bias in sensitive surveys...; 2009; Naher, A.- F., Krumpal, I.
- Interactive feedback can improve accuracy of responses in web surveys; 2009; Conrad, F. G., Couper, M. P., Tourangeau, R., Galesic, M.
- Effectiveness of incentives in mixed-mode systems: An evaluation of errors & costs; 2009; Lozar Manfreda, K., Berzelak, N., Vehovar, V.
- The influence of the field time on data quality in list-based Web surveys; 2009; Goeritz, A., Stieger, S.
- Twisting Rating Scales: Horizontal versus Vertical Visual Analogue Scales versus Categorical Scales...; 2009; Funke, F., Reips, U. -D.
- Individual Follow-up of the Target Population: the Plural Strategies of a Web Survey; 2009; Markou, E., de Cledat, B., Razafindratsima, N., Laurent, R., Issenhuth, P.
- How to cover the general public by Internet interviewing; 2009; Das, M.
- Telephone Survey and political behaviour estimates in 22 European countries: Evaluating the need for...; 2009; Hufken, V.
- What to do if Probability Sampling is Impossible in a Web Survey?; 2009; Markou, E., Razafindratsima, N., de Cledat, B., Issenhuth, P., Laurent, R.
- Paradata and Blaise: A Review of Recent Applications and Research; 2009; O’Reilly, J.
- If You Provide It, Will They Read It? Response Time Effects in a Choice Experiment; 2009; Vista, A. B., Rosenberger, R. S., Collins, A. R.
- Pictures in Web Surveys; 2009; Toepoel, V., Couper, M. P.
- National readership surveys: Moving from probability face-to-face surveys to Internet panels; 2009; Vehovar, V., Slavec, A., Petric, I., Sargac, M.
- An experiment on the effects of non-response reweighting on estimators' precision in a web survey; 2009; Fabrizi, E., Biffignandi, S., Toninelli, D.
- Dynamic feedback in open-ended questions: Experiments on the visual design language of Web surveys; 2009; Fuchs, M.
- Effects of monetary incentives on participation in a two-wave online survey; 2009; Bandilla, W., Haas, I.
- Response Order and Response Distributions: The Format of the Response Options in a Web Survey; 2009; Tourangeau, R., Conrad, F. G., Couper, M. P., Balter, O.
- Anticipated estimation from a panel Web survey: the case of the presence of tourists in the Province...; 2009; Scaffai, G., Pratesi, M.
- Is this e-mail relevant? An eyetracking experiment on how potential respondents read e-mail invitations...; 2009; Kaczmirek, L., Faaß, T., Galesic, M.
- Comparing the results of Web surveys on volunteer versus probabilistically selected panels of participants...; 2009; Galesic, M.
- Yes, VASs can! Increasing the accuracy of survey measurements with computerized visual analogue scales...; 2009; Funke, F., Reips, U. -D.
- Using Mail Contact to Sample and Encourage Submission of Questionnaire Answers Over the Internet; 2009; Dillman, D. A., Messer, B. L., Millar, M. M.
- Improving the Design of Complex Matrix Questions; 2009; Couper, M. P., Tourangeau, R., Conrad, F. G.
- Interactive aspects of web surveys; 2009; Conrad, F. G.
- Donations to charity as incentives in online panels; 2009; Goeritz, A.; Hox, J.
- Pros and Cons of Internet Surveys Compared to Traditional Survey Methods; 2009; Benjamin, G. D.
- Visual Design Effects on Respondents’ Behavior in Web-Surveys; 2009; Greinöcker, A.
- Separating Selection Bias and Non-coverage in Internet Panels using Propensity Matching; 2009; Lensvelt-Mulders, G. J., Lugtig, P. J., Hubregtse, M.
- Applying theory to structure respondents' stated motivations for participating in web surveys; 2009; Han, V., Albaum, G., Wiley, J. B., Thirkell, P.
- Choosing Between Internet and Mail Survey Modes for Choice Experiment Surveys Considering Non-Market...; 2009; Bøye Olsen, S.
- Social Attitude Differences between Internet Users and Non-users; 2009; Robinson, J. P., Martin, S. P.
- Online Election Surveys: Keeping the Voters Honest? ; 2009; Gibson, R., McAllister, I.
- Qualitative Research via Internet: Asynchronous Online Discussions and the Use of WebCT; 2009; Giatsi Clausen, M., Nicol, M., Gill, J.

