Web Survey Bibliography
Studies are finding that many previously held hypotheses about the effectiveness of varying incentive approaches remain intact when implemented in Web surveys. Given low per respondent costs in Web surveys, researchers take advantage of the ability to increase sample sizes, and frequently use sweepstakes based incentives, where respondents are entered into a drawing to win a fixed prize or prizes. The effectiveness of this kind of incentive has been mixed. However, a recent experiment of first contact mode and incentives types in a Web survey of 2,500 undergraduate college students conducted by these authors demonstrated that: 1. First respondent contact send via US Mail improves response rates over the use of email for first contact. 2. A sweepstakes drawing for $500 improves response rates over the use of no incentive. 3. A pre-paid $2 bill improves response rates over the use of the sweepstakes drawing for $500. 4. Use of a pre-paid $2 bill AND a drawing for $500 improves response rates over the use of either single incentive alone. In this study, the resulting response rate (AAPOR RR2) spread between treatment groups was 28%. The common assumption would be that with the increased response rates comes higher data quality. In looking at key measures in this study, we have found that there may in fact be significant data quality differences between the modes, including a finding of significantly different measures of smoking prevalence between experimental conditions. Singer (2002, Chapter 11 in Survey Nonresponse, eds. Groves, et al.) described that while incentives have their well documented intended consequences, they may as well have many unintended consequences on data quality. In this presentation we will discuss what we have found with regards to the impact these incentives have had on missing data, key variable response distributions, and sample composition.
Conference program
Web Survey Bibliography - The American Association for Public Opinion Research (AAPOR) 60th Annual Conference, 2005 (57)
- News Discrepancy and Information Search: The Effects of News Slants on Audiences' Information Search...; 2005; Hwang, H., Heo, K., Lee, S.-Y.
- The Market Value Survey: Ensuring Quality on a Government Web Based Survey; 2005; Flatley, J., Ruston, D.
- A Comparison of an Online Card Sorting Task to a Rating Task; 2005; Thomas, R. K., Bayer, L. R., Johnson, A. M., Behnke, C. S.
- Unintended Consequences of Incentive Induced Response Rate Differences; 2005; Pope, D., Crawford, S. D., Johnson, E. O., McCabe, S. E.
- The Use of Monetary Incentives in the Survey of Income and Program Participation; 2005; Lewis, D., Creighton, K.
- A Comparison of Presidential Candidate Vote Intention Measures in U.S. Elections; 2005; Thomas, R. K., Krane, D., Sanders, M. G., Behnke, C. S.
- An Investigation of Response Difference between Cell Phone and Landline Interviews; 2005; Dipko, S., Brick, P. D., Brick, J. M., Presser, S.
- Mode Effects in Customer Satisfaction Measurement; 2005; Stegier, D.M., Keil, L., Gaertner, G.
- Prompting Efforts to Raise Response Rates for a Web-Based Survey; 2005; Venkataraman, L., Parker, M.
- Vote Over-Reporting: Testing the Social Desirability Hypothesis in Telephone and Internet Surveys; 2005; Holbrook, A. L., Krosnick, J. A.
- The Impact of Follow-up Contacts od Survey Data and Response Rates; 2005; Westin, E., Harmon, M., Levin, K.
- Mixed Mode Data Collection Using Paper and Web Questionnaries. A Cost and Response Rate Comparison in...; 2005; Werner, P., Forsman, G.
- Are Web Options Making a Difference?; 2005; Mooney, G., Rogers, B., Wood, M., Trunzo, D.
- High Response Rate or Better Data Quality? Examining the Trade-offs for an Establishment Survey; 2005; Harris-Kojetin, L., Kiefer, K.
- To Vote or Not to Vote?: A Comparison of Vote Intention Measures; 2005; Thomas, R. K., Sanders, M. G., Smith, R., Behnke, C. S.
- Reporting Standards for Internet Surveys and Polls; 2005; Tychansky, R. S.
- Effect of Respondent Motivation and Tack Difficulty on Nondifferentiation in Ratings: A Test of Satisficing...; 2005; Anand, S., Krosnick, J. A., Mulligan, K., Smith, W., Green, M. C., Bizer, G. Y.
- Comparing Major Survey Firms in Terms of Survey Satisficing: Telephone and Internet Data Collection; 2005; Krosnick, J. A., Nie, N., Rivers, D.
- Response Order Effects in Online Surveys; 2005; Thomas, R. K., Behnke, C. S., Johnson, A. M.
- Causes of Context Effects: How Questionnaire Layout Induces Measurement Error; 2005; Peytchev, A., Tourangeau, R.
- Can You Hear Me Now?: Differences in Vote Behavior in the Cell and Landline Populations; 2005; Albaghal, T.
- Using the Web to Survey College Students: Institutional Characteristics That Influence Survey Quality...; 2005; Crawford, S. D., McCabe, S. E., Inkelas, K. K.
- What They See Is Not What We Intend-Gricean Effects in Web Surveys; 2005; Yan, T.
- Visual Context Effects in Web Surveys; 2005; Couper, M. P., Conrad, F. G., Tourangeau, R.
- Interactive Feedback Can Improve Quality of Responses in Web Surveys; 2005; Conrad, F. G., Couper, M. P., Tourangeau, R., Galesic, M.
- Data Quality Issues in a Multimode Survey; 2005; Wilson, C., Wright, D., Barton, T., Guerino, P.
- Web Survey Methodologies: A Comparison of Survey Accuracy; 2005; Krosnick, J. A., Nie, N., Rivers, D.
- Non-interviews in Mobile Phone Surveys; 2005; Vehovar, V.
- Quality Assessed: Cellular Phone Surveys versus Traditional Telephone Surveys; 2005; Steeh, C. G.
- Testing the Impact of Caller ID Technology on Response Rates in a Mixed Mode Survey; 2005; Trussell, N., Lavrakas, P. J.
- Re-examining Approaches to Achieving High Response Rates on Web-based Surveys of Post-secondary Students...; 2005; Lodato, B. N., Ghadialy, R.
- Qualitative Comparison of Paper and Online Self-Administered Modes; 2005; Grigorian, K. H., Sederstrom, S.
- Evaluating Nonsampling Errors in a Study Comparing Data Collected by Mail and Using the Web; 2005; Lesser, V. M., Newton, L.
- Effectiveness of E-mail and Paper Mail Notifications for Internet Surveys; 2005; Ruggiere, P., Ver Duin, D'Arlene
- Transforming a Paper Survey into a Web-based Survey: Respondent Experiences; 2005; Luyegu, A.
- A Profile of Self-Selecting Web Respondents; 2005; Guerino, P.
- What's Up Doc? Mixing Web and Mail Methods in a Survey of Physicians; 2005; Beebe, T. J., Locke, G. R., Barnes, S. A.
- Predicting Smapled Respondents' Likelihood to Cooperate in a Mail Survey: Part III; 2005; Burks, A. T., Lavrakas, P. J., Bennett, M.
- Sound Bytes: Capturing Audio in Survey Interviews; 2005; Hansen, S. E., Krysan, M., Couper, M. P.
- (Inter) Net Gain? Experiments to Increase Web-Based Response; 2005; Tourkin, S., Cox, S., Parmer, R., Zukerberg, A.
- Does Type of Pre-Notification Affect Web Survey Response Rates?; 2005; Harmon, M., Westin, E., Levin, K.
- Did You Get The Message? Using E-Mail and SMS for Prenotification in Web Surveys; 2005; Neubarth, W., Bosnjak, M., Bandilla, W., Couper, M. P., Kaczmirek, L.
- Analysis of Break-off Patterns in Web Surveys; 2005; Ahsan, S., Broach, R. J.
- The Effect of Incentives on Two Physician Mail Surveys: A Response Rate Comparison; 2005; Christian, J.
- Value and Timing Strategies in Prize Draws: A Further Examination of the Immediacy Effect in Web Surveys...; 2005; Tuten, T. L., Galesic, M., Bosnjak, M.
- Comparative Analyses of Parallel Paper, Phone, and Web Surveys With and Without Incentives: What Differences...; 2005; Olsen, D., Call, V., Wygant, S.
- Characteristics Related to Cell Phone Status: Why Generation Y Should be Targeted; 2005; Hancock, L.
- Mode Effects for Hybrid Telephone/Internet Surveys and Reaching Cellphone-Only Households; 2005; Kulp, D., Herrmann, M., Dutwin, D., Lavine, S.
- In Search of Equivalency across Modes: Experimental Results Comparing Alternative Question Formats for...; 2005; Christian, L. M., Dillman, D. A., Smyth, J. D.
- Survey Mode Effects: Comparison between Telephone and Web; 2005; Speizer, H., Baker, R. P., Schneider, K.
