Web Survey Bibliography
There is concern that professional respondents, motivated more by monetary incentives than the opportunity to provide thoughtful answers, may compromise data quality in on-line surveys. The worry is that such respondents primarily take actions on the “critical path” toward their monetary goal even though valid answers may require additional, “off-path” actions. Our main questions are whether professional respondents are quicker to find the critical path and adhere to it more closely than "non-professionals." We explored this in a web survey in which 2404 volunteer respondents answered two constant-sum questions, i.e., multi-part items whose answers must add to 100% (fourteen internet use categories) or 24 hours (eleven daily activities). Respondents could not advance unless their answers were well-formed (i.e., equal to the target sum). About one third of the respondents could click for a running tally to facilitate well-formedness, placing this action on the critical path. We considered respondents who belonged to more than 3 volunteer panels to be professional (58% had completed more than 30 web surveys). This distinction mattered. Professionals were more likely than non-professionals to request a tally for the first item but the quality of both groups’ responses benefited from the tally: more non-zero, non-missing answers and fewer rounded responses with than without the tally. However, by the second item, professional respondents seemed to learn that providing valid answers was not on the critical path. While professionals again requested the tally more often, the tally only improved the quality of answers for nonprofessionals: more non-zero, non-missing answers and less time spent on “other” activities with than without the tally; professionals’ answers showed no such improvement from the tally. The results suggest that professional respondents are more likely to provide well-formed than valid answers because validity is not on the critical path.
Conference Homepage (abstract)
Web survey bibliography (4086)
- The Rise of Survey Programming Automation as an Alternative to Outsourcing; 2010; Ahmed, A. S., Guyer, L.
- How is Emerging Technology/Web 2.0 Changing Gathering Consumer Feedback and the Delivery of Data? ; 2010; Price, K., Patel, N.
- Sexy Questions, Dangerous Results? - Exploring the Impact of Rich Media Question Formats in Online Survey...; 2010; Malinoff, B.
- Mobile Research: New Platform, New Thinking ; 2010; Johnson, A. J., Conry, S.
- Managing Quality in Large Multi-Country / Multi-Category / Multi-Modal Studies; 2010; Thompson, J.
- Mobile Research – The future’s in their hands: Exploring the Application of Digital Research...; 2010; Dodgson, S.
- Factorial Design on Survey Router Configuration Effect by Sample Source; 2010; Fawson, B., Johnson, E. P.
- Predicting the Future with Social Media ; 2010; Asur, S., Huberman, B. A.
- News Platform Preference: Advancing the Effects of Age and Media Consumption on Political Participation...; 2010; Bachmann, I., Kaufhold, K., Lewis, S. C., de Zuniga, H. G.
- ReCal: Intercoder Reliability Calculation as a Web Service ; 2010; Freelon, D. G.
- Statistics Canada's Process Automation of On-line Survey Development and CATI Data Integration; 2010; Dubois, M.-A.
- Recruiting Online Panel Members from a Mail survey in the General Population: Results from an Exploratory...; 2010; Reuband, K. H.
- Operational Aspects of Recruiting High Internet Users via a CATI Screening on an RDD Frame; 2010; Batra, P.
- Uses of YouTube, and Other Web 2.0 Applications, in Data Collection; 2010; Franklin, J.
- Towards Usage of Web 2.0 Technology and Avatars for Web Surveys; 2010; Malakhoff, L.
- Technical Challenges in the Development and Implementation of QUEST (CARI Monitoring System); 2010; Sattaluri, S., Spain, C., Nguyen, M., Thissen, R.
- Off-the-shelf Web Software: Qualtrics; 2010; Warren, N.
- Web Based Paper Form Verification Using QueXF; 2010; Zammit, A.
- Cell Connectivity Options for Field Interviewing ; 2010; Nofziger, J., Griggs, C.
- Advance Notice Impact on Web Reporting Response Rates; 2010; Gomes, T., Harrell, L. J., Hatch Maxfield, J., Hertwig, R.
- Normalized Database Structure to Support Survey Fulfillment Operations; 2010; Sikes, N., Pittman, J., Hazel, K.
- Hatteras Survey System: On-path Validation for a Non-linear Survey Engine; 2010; Suresh, R., Allen, S., Peele, B., Rasmussen, C., Sattler, S., Suresh, P., Warmoth, E.
- When the water is right.; 2010; Andruss, P.
- The Role of Landline and Cell Phone Usage Patterns in Nonreponse Error Potential Among Young Adults...; 2010; Currivan, D. B., Levine, B., Mayo, Ni.
- Differences in Early and Late Responders: Findings from a Military Web-Based Community Survey.; 2010; Prabhakaran, J., Spera, C., Leach, L. M., Foster, R.
- Assessing Cell Phone Noncoverage Bias Across Different Topics and Subgroups; 2010; Christian, L. M., Keeter, S., Purcell, K., Smith, A.
- Using a Simulation Study to Examine Strategies for Combining Cell and Landline Survey Samples; 2010; Duffy, T., Bausch, S., Iachan, R., Lu, B.
- Representing Seniors in an Online National Probability Panel Survey: Measuring Technology Attitudes...; 2010; Peugh, J., Mansfield, W., Wells, T., Semans, K.
- Communicating Disclosure Risk in Informed Consent Statements; 2010; Singer, E., Couper, M. P.
- Meeting the Challenges of Converting a Large Establishment Survey from Paper to Electronic Administration...; 2010; Roe, D. J., Thalji, L., Loft, J., Flicker, L., Stockdale, J., Stagnitti, M.
- Assessing the Accuracy of the Face-to-Face Recruited Internet Survey Platform: A Comparison of Behavioral...; 2010; Villar, A., Malka, A., Krosnick, J. A.
- Internet Panels and Health Research: Findings from National RDD Surveys.; 2010; Boyle, J.
- Item Nonresponse Analysis for a Mixed-Mode Survey.; 2010; Lorenc, B., Olsson, K.
- Significant Factors Governing the Use of Auditory Stimuli in Web Questionnaires; 2010; Utami, S. S., Dawood, R., Navvab, M.
- The Subject Lines of Web Survey Invitations and Participation Rates; 2010; Titiz, H., Ziniel, S.
- Experimental Trial of Benefit Appeals on Completion Rates for the Agricultural Screening Survey; 2010; Atkinson, D., Moore, D., McCarthy, J. S.
- Using Overt and Covert Survey Traps to Maximize Data Quality; 2010; Cardador, J., Wayman, M., Sheridan, M.
- Professional Web Respondents and Data Quality; 2010; Conrad, F. G., Tourangeau, R., Couper, M. P., Zhang, C.
- Does Making The Survey Topic More Salient Lead To An Expert Bias? – The Influence of Announcing...; 2010; Keusch, F., Mayerhofer, W., Weilbuchner, N., Jungreithmaier, S.
- Time Related Inconsistencies in Global Online Panels; 2010; Gittelman, S. H., Trimarchi, E.
- Study of Non-Probability Sample Internet Surveys' Estimates of Consumer Product Usage and Demographic...; 2010; Yeager, D. S., Carter, A., Tewoldemedhin, H., Krosnick, J. A.
- An Experiment to Test the Feasibility and Quality of a Web-Based Questionnaire of Teachers; 2010; Jacob, R., Scott, L., Rowan, B.
- Impact of Monetary Incentives and Web Survey Option in the 2008 National Survey of Recent College Graduates...; 2010; Heaviside, S., Jang, D., Mooney, G., Barrett, K., Kang, K. H.
- Response Mode and Bias Analysis in the IRS' Individual Taxpayer Burden Survey; 2010; Masken, K., Contos, G., Nord, R., Brick, J. M.
- Diversity of Methods: Assessment of Quantitative and Qualitative Research Multiplier Effects.; 2010; Ballou, J., Roff, B., Anderson, M.
- Does Providing a Choice of Survey Modes Influence Response?; 2010; Lesser, V. M., Newton, L., Yang, D.
- Improving Response to Mail and Web Mixed-Mode Surveys: The Effects of Offering Choice on Survey Response...; 2010; Millar, M. M., Dillman, D. A.
- Participant Dropout as a Function of Survey Length in Internet-Mediated University Studies: Implications...; 2010; Hoerger, M.
- Internet Access: Is Everyone Online Yet and Can We Survey Them There?; 2010; Smith, Co., Spitz, G.
- Panel management in a mixed-mode (Web/mobile) research world ; 2010; Townsend, L.