Web Survey Bibliography
Studies have shown that various features of the presentation of the response options can affect the distribution of the answers. For example, as work by Schwarz has shown, the numerical labels attached to the scale points can change the apparent meaning of the options; similarly, the colors assigned to the different scale points seems to affect the answers respondents give. In this study, we examine the impact of the spacing of the response options on their relative popularity. In a randomized experiment embedded in a Web survey, we systematically varied the spacing of the options in a series of items using a five-point agreement scale. For some respondents, the scale endpoints were given more space in the scale than the three middle points. For another group of respondents, the scale midpoint (indicating neutrality) was given more space. Finally, for a third group of respondents, the scale points were evenly spaced. We thought that giving an option more space would increase its visual prominence and that this increased prominence would increase the likelihood that respondents would select the option. The results are generally in line with the visual prominence hypothesis. When the extreme options were given more space, respondents were more likely to select; this effect was apparent for four of the six items (and in several analyses across items). The effect of giving the neutral midpoint more space was less clear; only one of the six items shows a significant increase in the popularity of the neutral response when that option was more prominent. This may reflect the relative rarity of such responses. This is one of several studies demonstrating the importance of the visual prominence of information in Web surveys.
Homepage (abstract)
Web survey bibliography - Kennedy, C. (11)
- Evaluating Three Approaches to Statistically Adjust for Mode Effects; 2016; Kolenikov, S.; Kennedy, C.
- Cell RDD Respondents Unmasked: Progress Report on Geo and Demo Appends to the Wireless Frame; 2015; DiSogra, C.; Kennedy, C.Mosher, M.
- Mode effect analysis and adjustment in a split-sample mixed-mode Web/CATI survey; 2013; Kolenikov, S., Kennedy, C.
- Use of Cognitive Shortcuts in Landline and Cell Phone Surveys; 2011; Everett, S. E., Kennedy, C.
- Nonresponse and Measurement Error in Mobile Phone Surveys ; 2010; Kennedy, C.
- Measurement Error in Cell Phone Surveys; 2009; Kennedy, C., Everett, S. E., Traugott, M. W.
- Mechanisms of Nonresponse in Cell Phone Surveys; 2009; Kennedy, C., Everett, S. E., Traugott, M. W.
- Interactive Interventions in Web Surveys Can Increase Respondent Conscientiousness; 2009; Conrad, F. G., Tourangeau, R., Couper, M. P., Kennedy, C.
- Cell-Phone-Only Voters in the 2008 Exit Poll and Implications for Future Noncoverage Bias ; 2009; Mokrzycki, M., Keeter, S., Kennedy, C.
- Costs and Benefits from Conducting a Supplemental Sample of Cell Phone Numbers in National RDD Surveys...; 2008; Kennedy, C.
- The Impact of the Spacing of the Scale Options in a Web Survey; 2008; Kennedy, C., Tourangeau, R., Conrad, F. G., Couper, M. P., Redline, C. D.