Web Survey Bibliography
There is concern that professional respondents, motivated more by monetary incentives than the opportunity to provide thoughtful answers, may compromise data quality in on-line surveys. The worry is that such respondents primarily take actions on the “critical path” toward their monetary goal even though valid answers may require additional, “off-path” actions. Our main questions are whether professional respondents are quicker to find the critical path and adhere to it more closely than "non-professionals." We explored this in a web survey in which 2404 volunteer respondents answered two constant-sum questions, i.e., multi-part items whose answers must add to 100% (fourteen internet use categories) or 24 hours (eleven daily activities). Respondents could not advance unless their answers were well-formed (i.e., equal to the target sum). About one third of the respondents could click for a running tally to facilitate well-formedness, placing this action on the critical path. We considered respondents who belonged to more than 3 volunteer panels to be professional (58% had completed more than 30 web surveys). This distinction mattered. Professionals were more likely than non-professionals to request a tally for the first item but the quality of both groups’ responses benefited from the tally: more non-zero, non-missing answers and fewer rounded responses with than without the tally. However, by the second item, professional respondents seemed to learn that providing valid answers was not on the critical path. While professionals again requested the tally more often, the tally only improved the quality of answers for nonprofessionals: more non-zero, non-missing answers and less time spent on “other” activities with than without the tally; professionals’ answers showed no such improvement from the tally. The results suggest that professional respondents are more likely to provide well-formed than valid answers because validity is not on the critical path.
Conference Homepage (abstract)
Web survey bibliography - Tourangeau, R. (45)
- Reducing speeding in web surveys by providing immediate feedback; 2017; Conrad, F.; Tourangeau, R.; Couper, M. P.; Zhang, C.
- Using eye-tracking to understand how fourth grade students answer matrix items; 2015; Maitland, A.; Sun, H.; Caporaso, A.; Tourangeau, R.; Bertling, J.; Almonte, D.
- Measurement Properties of Web Surveys; 2015; Tourangeau, R.
- Providing a Deadline for Response: Results from Two Recent Experiments; 2014; Kaiser, A., Walston, J. T., Medway, R., Ye, C., Tourangeau, R.
- The Relations Among Different Cognitive Shortcuts in Surveys; 2013; Tourangeau, R., Medway, R., Presser, S.
- Anonymity and Confidentiality; 2012; Tourangeau, R.
- Modes of Data Collection; 2012; Tourangeau, R.
- Database Lookup in Web Surveys; 2012; Couper, M. P., Zhang, C., Conrad, F. G., Tourangeau, R.
- Question Order Effect: A Web Survey Experiment with Paradata; 2012; Ye, C., Tourangeau, R.
- Should I Stay or Should I go: The Effects of Progress Feedback, Promised Task Duration, and Length of...; 2011; Yan, T., Conrad, F. G., Tourangeau, R., Couper, M. P.
- Nonresponse Error, Measurement Error, And Mode Of Data Collection: Tradeoffs in a Multi-mode Survey...; 2011; Sakshaug, J. W., Yan, T., Tourangeau, R.
- The psychology or survey response. An ASA webinar; 2010; Tourangeau, R.
- The psychology of survey response, 2nd Edition; 2010; Tourangeau, R., Bradburn, N. M.
- Professional Web Respondents and Data Quality; 2010; Conrad, F. G., Tourangeau, R., Couper, M. P., Zhang, C.
- Increasing Respondents' Use of Definitions in Web Surveys; 2010; Peytchev, A., Conrad, F. G., Couper, M. P., Tourangeau, R.
- Interactive Interventions in Web Surveys Can Increase Respondent Conscientiousness; 2009; Conrad, F. G., Tourangeau, R., Couper, M. P., Kennedy, C.
- Experimenting With Speech Interactive Voice Response, Touchtone Data Entry and the Web for the National...; 2009; Cantor, D., Brick, P. D., Tourangeau, R., Conrad, F. G.
- Interactive feedback can improve accuracy of responses in web surveys; 2009; Conrad, F. G., Couper, M. P., Tourangeau, R., Galesic, M.
- Response Order and Response Distributions: The Format of the Response Options in a Web Survey; 2009; Tourangeau, R., Conrad, F. G., Couper, M. P., Balter, O.
- Improving the Design of Complex Matrix Questions; 2009; Couper, M. P., Tourangeau, R., Conrad, F. G.
- Survey Methodology (Wiley Series in Survey Methodology); 2009; Groves, R. M., Fowler, F. J., Couper, M. P., Lepkowski, J. M., Singer, E., Tourangeau, R.
- Social desirability bias in CATI, IVR and Web surveys: The effects of mode and question sensitivity; 2008; Kreuter, F., Presser, S., Tourangeau, R.
- Experiments Exploring the Relationship (or Lack Thereof) Between Nonresponse Error and Measurement Error...; 2008; Tourangeau, R., Groves, R. M., Presser, S., Toppe, C., Kennedy, K., Yan, T.,
- The Impact of the Spacing of the Scale Options in a Web Survey; 2008; Kennedy, C., Tourangeau, R., Conrad, F. G., Couper, M. P., Redline, C. D.
- Fast times and easy questions: the effects of age, experience and question complexity on web survey...; 2008; Yan, T., Tourangeau, R.
- Sensitive questions in surveys; 2007; Tourangeau, R., Yan, T.
- What is Sexual Harassment? It Depends on Who Asks! Framing Effects on Survey Responses; 2007; Galesic, M., Tourangeau, R.
- The Impact of the Visible: The Design of Web Surveys; 2007; Tourangeau, R., Couper, M. P., Conrad, F. G.
- How the shape and format of input fields affect answer; 2007; Couper, M. P., Tourangeau, R., Conrad, A.
- Experiments in Producing Nonresponse Bias ; 2006; Groves, R. M., Couper, M. P., Presser, S., Singer, E., Tourangeau, R., Piani Acosta, G., Nelson, Li.
- Color, Labels, and Interpretive Heuristics for Response Scales; 2006; Tourangeau, R., Couper, M. P., Conrad, F. G.
- An Experimental Comparison Of Web And Telephone Surveys; 2005; Fricker, S., Galesic, M., Tourangeau, R., Yan, T.
- Visual Context Effects in Web Surveys; 2005; Couper, M. P., Conrad, F. G., Tourangeau, R.
- Does Voice Matter? An Interactive Voice Response (IVR) Experiment; 2004; Couper, M. P., Singer, E., Tourangeau, R.
- Spacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions; 2004; Tourangeau, R., Conrad, F. G., Couper, M. P.
- Picture This! Exploring Visual Effects in Web Surveys; 2004; Couper, M. P., Tourangeau, R., Kenyon, K.
- Web-based data collection; 2003; Tourangeau, R.
- Cognitive Aspects of Survey Measurement and Mismeasurement; 2003; Tourangeau, R.
- Understanding the effects of audio-CASI on self-reports of sensitive behavior; 2003; Couper, M. P., Singer, E., Tourangeau, R.
- Humanizing self-administered surveys: experiments on social presence in web and IVR surveys; 2003; Tourangeau, R., Couper, M. P., Steiger, D. M., de Rouvray, C.
- Use and non-use of clarification features in web surveys; 2003; Tourangeau, R., P., Couper, M. P., Conrad, F. G., Baker, R. P.
- What They See Is What We Get: Response Options for Web Surveys; 2003; Couper, M. P., Tourangeau, R., Conrad, F. G., Crawford, S. D.
- Self-administered questions by telephone: Evaluating interactive voice response; 2002; Tourangeau, R., Steiger, D. M.,
- Collecting sensitive information with different modes of data collection; 1998; Couper, M. P., Tourangeau, R., Smith, T. W.
- Cognitive science and survey methods; 1984; Tourangeau, R.