Web Survey Bibliography
We carried out two experiments to investigate how the shading of the options in a response scale affected the answers to the survey questions. The experiments were embedded in two web surveys, and they varied whether the two ends of the scale were represented by shades of the same or different hues. The experiments also varied the numerical labels for the scale points and examined responses to both unipolar scales (assessing frequency) and bipolar scales (assessing favorability). We predicted that the use of different hues would affect how respondents viewed the low end of the scale, making responses to that end seem more extreme than when the two ends were shades of the same hue. This hypothesis was based on the notion that respondents use various interpretive heuristics in assigning meaning to the visual features of survey questions. One such cue is visual similarity. When two options are similar in appearance, respondents will see them as conceptually closer than when they are dissimilar in appearance. The results were generally consistent with this prediction. When the end points of the scale were shaded in different hues, the responses tended to shift toward the high end of the scale, as compared to scales in which both ends of the scale were shaded inthe same hue. Though noticeable, this shift was less extreme than the similar shift produced when negative numbers were used to label one end of the scale; moreover, the effect of color was eliminated when each scale point had a verbal label. These findings suggest that respondents have difficulty using scales and pay attention even to incidental features of the response scales in interpreting the scale points.
Journal (full text)
Web Survey Bibliography - Public Opinion Quarterly (POQ) (107)
- On the Use of Latent Variable Models to Detect Differences in the Interpretation of Vague Quantifiers...; 2013; Griffin, J.
- Clarifying Categorical Concepts in a Web Survey.; 2013; Redline, C. D.
- Up Means Good: The Impact of Screen Position on Evaluative Ratings in Web Surveys.; 2013; Tourangeau, R., Conrad, F. G., Couper, M. P.
- Does mentioning "Some People" and "Other People" in an opinion question improve...; 2012; Yeager, D. S., Krosnick, J. A.
- A Comparison of Alternative Indicators for the Risk of Nonresponse Bias; 2012; Wagner, J.
- Differences by Survey Language and Mode among Chinese Respondents to a CAHPS Health Plan Survey; 2012; Elliott, M. N., Edwards, W. S., Klein, J. D., Heller, A.
- Recruiting A Probability Sample For An Online Panel: Effects Of Contact Mode, Incentives, And Information...; 2012; Scherpenzeel, A., Toepoel, V.
- When More Gets You Less: A Meta-Analysis of the Effect of Concurrent Web Options on Mail Survey Response...; 2012; Medway, R., Fulton, J.
- Does Giving People Their Preferred Survey Mode Actually Increase Survey Participation Rates?; 2012; Olson, K., Smyth, J. D., Wood, H.
- Multiple Imputation for Unit Nonresponse and Measurement Error; 2012; Peytchev, A.
- The changing role of address-based sampling in survey research; 2011; Iannacchione, V. G.
- Measuring americans' issue priorities. A new version of the most important problem question reveals...; 2011; Yeager, D. S., Larson, S. B., Krosnick, J. A., Tompson, T.
- Questions for Surveys: Current Trends and Future Directions; 2011; Schaeffer, N. C., Schaeffer, N. C.
- The Future of Modes of Data Collection; 2011; Couper, M. P.
- The Future of Survey Sampling; 2011; Brick, J. M.
- The Impact of “Forgiving” Introductions on the Reporting of Sensitive Behavior in Surveys...; 2011; Peter, J., Valkenburg, P. M.
- Comparing the Accuracy of RDD Telephone Surveys and Internet Surveys Conducted with Probability and...; 2011; Yeager, D. S., Krosnick, J. A., Chang, L. C., Javitz, H. S., Levendusky, M. S., Simpser, A., Wang, R...
- Surveying the General Public over the Internet Using Address-Based Sampling and Mail Contact Procedures...; 2011; Messer, B. L., Dillman, D. A.
- Use of Cognitive Shortcuts in Landline and Cell Phone Surveys; 2011; Everett, S. E., Kennedy, C.
- Improving Response To Web and Mixed-Mode Surveys; 2011; Millar, M. M., Dillman, D. A.
- An Alternative to the Response Rate for Measuring a Survey's Realization of the Target Population; 2011; Skalland, B.
- Can Verbal Instructions Counteract Visual Context Effects in Web Surveys?; 2011; Toepoel, V., Couper, M. P.
- Nonresponse Error, Measurement Error, And Mode Of Data Collection: Tradeoffs in a Multi-mode Survey...; 2011; Sakshaug, J. W., Yan, T., Tourangeau, R.
- A Method for Evaluating Mode Effects in Mixed-mode Surveys; 2011; Vannieuwenhuyze, J., Loosveldt, G., Molenberghs, G.
- Total Survey Error: Design, Implementation, and Evaluation; 2011; Biemer, P. P.
- Comparing the Accuracy of RDD Telephone Surveys and Internet Surveys Conducted with Probability and...; 2011; Yeager, D. S., Krosnick, J. A., Chang, L. C., Javitz, H. S., Levindusky, M. S., Simpser, A.; Wang, R...
- Total Survey Error: past, present, and future; 2010; Groves, R. M., Lyberg, L. E.
- Research synthesis. AAPOR report on online panels; 2010; Brick, J. M. et al.
- Recruiting probability samples for a multi-mode research panel with Internet and mail components; 2010; Rao, K.
- Cell-Phone-Only Voters in the 2008 Exit Poll and Implications for Future Noncoverage Bias ; 2009; Mokrzycki, M., Keeter, S., Kennedy, C.
- Zero Banks: Coverage Error and Bias in Rdd Samples Based on Hundred Banks with Listed Numbers ; 2009; Boyle, J., Bucuvalas, M., Piekarski, L., Weiss, A.
- National Surveys Via RDD Telephone Interviewing vs. the Internet: Comparing Sample Representativeness...; 2009; Chang, L. C., Krosnick, J. A.
- Effects of Questionnaire Length on Participation and Indicators of Response Quality in a Web Survey; 2009; Galesic, M., Bosnjak, M.
- The Framing of the Survey Request and Panel Attrition; 2009; Tourangeau, R., Ye, J.
- Optimal Design of Branching Questions to Measure Bipolar Constructs; 2009; Malhotra, N., Krosnick, J. A., Thomas, R. K.
- Taking the Audio Out of Audio-CASI; 2009; Tourangeau, R., Couper, M. P., Marvin, T.
- Impact of T-ACASI on Survey Measurements of Subjective Phenomena ; 2009; Harmon, T., F., Rogers, S. M., Eggleston, E., Roman, A. M., Villarroel, M. A., Chromy, J. R., Ganapathi...
- Open-Ended Questions in Web Surveys: Can Increasing the Size of Answer Boxes and Providing Extra Verbal...; 2009; Smyth, J. D., Dillman, D. A., Christian, L. M., McBride, M.
- Order Effects in Complex and Simple Tasks; 2009; Malhotra, N.
- Survey Breakoff; 2009; Peytchev, A.
- Effects of Design in Web Surveys: Comparing Trained and Fresh Respondents ; 2009; Toepoel, V., Das, M., van Soest, A.
- Social Desirability Bias in CATI, IVR, and Web Surveys: The Effects of Mode and Question Sensitivity...; 2009; Kreuter, F., Presser, S., Tourangeau, R.
- Eye-Tracking Data: New Insights on Response Order Effects and Other Cognitive Shortcuts in Survey Responding...; 2009; Galesic, M., Tourangeau, R., P.;Couper, M. P., Conrad, F. G.
- Web Survey Methods: Introduction; 2009; Couper, M. P., Miller, P. V.
- Computing Response Metrics for Online Panels; 2009; Callegaro, M., DiSogra, C.
- Does a Probability-Based Household Panel Benefit from Assignment to Postal Response as an Alternative...; 2008; Rookey, B. D., Hanway, S., Dillman, D. A.
- Eliciting Subjective Probabilities in Internet Surveys; 2008; Delavande, A., Rohwedder, S.
- Completion Time and Response Order Effects in Web Surveys; 2008; Malhotra, N.
- Face-to-face versus web surveying in a high Internet coverage population: differences in response quality...; 2008; Heerwegh, D., Loosveldt, G.
- The "Downstream" Effect of Token Prepaid Cash Incentives to Parents on Their Young Adult Children...; 2008; Mann, S. L., Lynn, D. J., Peterson, A. V.
