Web Survey Bibliography
There is concern that professional respondents, motivated more by monetary incentives than the opportunity to provide thoughtful answers, may compromise data quality in on-line surveys. The worry is that such respondents primarily take actions on the “critical path” toward their monetary goal even though valid answers may require additional, “off-path” actions. Our main questions are whether professional respondents are quicker to find the critical path and adhere to it more closely than "non-professionals." We explored this in a web survey in which 2404 volunteer respondents answered two constant-sum questions, i.e., multi-part items whose answers must add to 100% (fourteen internet use categories) or 24 hours (eleven daily activities). Respondents could not advance unless their answers were well-formed (i.e., equal to the target sum). About one third of the respondents could click for a running tally to facilitate well-formedness, placing this action on the critical path. We considered respondents who belonged to more than 3 volunteer panels to be professional (58% had completed more than 30 web surveys). This distinction mattered. Professionals were more likely than non-professionals to request a tally for the first item but the quality of both groups’ responses benefited from the tally: more non-zero, non-missing answers and fewer rounded responses with than without the tally. However, by the second item, professional respondents seemed to learn that providing valid answers was not on the critical path. While professionals again requested the tally more often, the tally only improved the quality of answers for nonprofessionals: more non-zero, non-missing answers and less time spent on “other” activities with than without the tally; professionals’ answers showed no such improvement from the tally. The results suggest that professional respondents are more likely to provide well-formed than valid answers because validity is not on the critical path.
Conference Homepage (abstract)
Web survey bibliography - 2010 (251)
- Perspectives on Web Survey Development: Views from Programmers, Content Specialists, and Survey Methodologists...; 2010; Downey, K.
- Using a Mixed-Mode Design to Survey Ethnic Minorities?; 2010; Feskens, R., Kappelhof, J.
- Blogosphere and Democracy in Portugal–Results of a Websurvey; 2010; Carvalho, T., Casanova, J. L.
- Recent Findings on Using Rich Media in Online Surveys; 2010; Malinoff, B., Henning, J.
- Digital, Social Moms: Using Social Media to Increase Respondent Engagement and Decrease Recruiting Costs...; 2010; Stemberg, C., Rimmer, L., Weinstein, D.
- From Buzz to Biz: Social Media Research for Results; 2010; Pettit, F. A.
- Archiving and Re-using Qualitative and Qualitative Longitudinal Data in Slovenia; 2010; Stebe, J., Hudales, J., Kragelj, B.
- Establishing a Qualitative Data Archive in Austria; 2010; Smioski, A.
- Methodological and Ethical Dilemmas of Archiving Qualitative Data; 2010; Kuula, A.
- The Rise of Survey Programming Automation as an Alternative to Outsourcing; 2010; Ahmed, A. S., Guyer, L.
- How is Emerging Technology/Web 2.0 Changing Gathering Consumer Feedback and the Delivery of Data? ; 2010; Price, K., Patel, N.
- Sexy Questions, Dangerous Results? - Exploring the Impact of Rich Media Question Formats in Online Survey...; 2010; Malinoff, B.
- Mobile Research: New Platform, New Thinking ; 2010; Johnson, A. J., Conry, S.
- Managing Quality in Large Multi-Country / Multi-Category / Multi-Modal Studies; 2010; Thompson, J.
- Mobile Research – The future’s in their hands: Exploring the Application of Digital Research...; 2010; Dodgson, S.
- Factorial Design on Survey Router Configuration Effect by Sample Source; 2010; Fawson, B., Johnson, E. P.
- Predicting the Future with Social Media ; 2010; Asur, S., Huberman, B. A.
- News Platform Preference: Advancing the Effects of Age and Media Consumption on Political Participation...; 2010; Bachmann, I., Kaufhold, K., Lewis, S. C., de Zuniga, H. G.
- ReCal: Intercoder Reliability Calculation as a Web Service ; 2010; Freelon, D. G.
- Statistics Canada's Process Automation of On-line Survey Development and CATI Data Integration; 2010; Dubois, M.-A.
- Recruiting Online Panel Members from a Mail survey in the General Population: Results from an Exploratory...; 2010; Reuband, K. H.
- Operational Aspects of Recruiting High Internet Users via a CATI Screening on an RDD Frame; 2010; Batra, P.
- Uses of YouTube, and Other Web 2.0 Applications, in Data Collection; 2010; Franklin, J.
- Towards Usage of Web 2.0 Technology and Avatars for Web Surveys; 2010; Malakhoff, L.
- Technical Challenges in the Development and Implementation of QUEST (CARI Monitoring System); 2010; Sattaluri, S., Spain, C., Nguyen, M., Thissen, R.
- Off-the-shelf Web Software: Qualtrics; 2010; Warren, N.
- Web Based Paper Form Verification Using QueXF; 2010; Zammit, A.
- Cell Connectivity Options for Field Interviewing ; 2010; Nofziger, J., Griggs, C.
- Advance Notice Impact on Web Reporting Response Rates; 2010; Gomes, T., Harrell, L. J., Hatch Maxfield, J., Hertwig, R.
- Normalized Database Structure to Support Survey Fulfillment Operations; 2010; Sikes, N., Pittman, J., Hazel, K.
- Hatteras Survey System: On-path Validation for a Non-linear Survey Engine; 2010; Suresh, R., Allen, S., Peele, B., Rasmussen, C., Sattler, S., Suresh, P., Warmoth, E.
- When the water is right.; 2010; Andruss, P.
- The Role of Landline and Cell Phone Usage Patterns in Nonreponse Error Potential Among Young Adults...; 2010; Currivan, D. B., Levine, B., Mayo, Ni.
- Differences in Early and Late Responders: Findings from a Military Web-Based Community Survey.; 2010; Prabhakaran, J., Spera, C., Leach, L. M., Foster, R.
- Assessing Cell Phone Noncoverage Bias Across Different Topics and Subgroups; 2010; Christian, L. M., Keeter, S., Purcell, K., Smith, A.
- Using a Simulation Study to Examine Strategies for Combining Cell and Landline Survey Samples; 2010; Duffy, T., Bausch, S., Iachan, R., Lu, B.
- Representing Seniors in an Online National Probability Panel Survey: Measuring Technology Attitudes...; 2010; Peugh, J., Mansfield, W., Wells, T., Semans, K.
- Communicating Disclosure Risk in Informed Consent Statements; 2010; Singer, E., Couper, M. P.
- Meeting the Challenges of Converting a Large Establishment Survey from Paper to Electronic Administration...; 2010; Roe, D. J., Thalji, L., Loft, J., Flicker, L., Stockdale, J., Stagnitti, M.
- Assessing the Accuracy of the Face-to-Face Recruited Internet Survey Platform: A Comparison of Behavioral...; 2010; Villar, A., Malka, A., Krosnick, J. A.
- Internet Panels and Health Research: Findings from National RDD Surveys.; 2010; Boyle, J.
- Item Nonresponse Analysis for a Mixed-Mode Survey.; 2010; Lorenc, B., Olsson, K.
- Significant Factors Governing the Use of Auditory Stimuli in Web Questionnaires; 2010; Utami, S. S., Dawood, R., Navvab, M.
- The Subject Lines of Web Survey Invitations and Participation Rates; 2010; Titiz, H., Ziniel, S.
- Experimental Trial of Benefit Appeals on Completion Rates for the Agricultural Screening Survey; 2010; Atkinson, D., Moore, D., McCarthy, J. S.
- Using Overt and Covert Survey Traps to Maximize Data Quality; 2010; Cardador, J., Wayman, M., Sheridan, M.
- Professional Web Respondents and Data Quality; 2010; Conrad, F. G., Tourangeau, R., Couper, M. P., Zhang, C.
- Does Making The Survey Topic More Salient Lead To An Expert Bias? – The Influence of Announcing...; 2010; Keusch, F., Mayerhofer, W., Weilbuchner, N., Jungreithmaier, S.
- Time Related Inconsistencies in Global Online Panels; 2010; Gittelman, S. H., Trimarchi, E.
- Study of Non-Probability Sample Internet Surveys' Estimates of Consumer Product Usage and Demographic...; 2010; Yeager, D. S., Carter, A., Tewoldemedhin, H., Krosnick, J. A.