Notice: the WebSM website has not been updated since the beginning of 2018.

Web Survey Bibliography

Title Designing Scalar Questions for Web Surveys
Source Sociological Methods & Research, 37, 3, pp. 393-425
Year 2009
Access date 25.02.2009

This paper explores how the visual design of scalar questions influences responses in web surveys. We present the results of five experiments embedded in two web surveys of university students. We find that consistently presenting the positive end of the scale first did not impact responses but increases response times. Displaying the categories in multiple columns influence how respondents process the scale and increase response times. Separating the midpoint, ``don't know'' option, or endpoints spatially does not impact responses when the visual and conceptual midpoint align. Removing the graphical layout of the scale influences responses when lower numbers indicate more positive categories and increases response time. Finally, response times are longer for polar point scales with numeric labels, but there are no differences in responses. Overall, our results suggest that the visual design of response scales impacts measurement, but that some manipulations produce larger and more significant differences than others.

Access/Direct link

Journal Homepage (abstract)

Year of publication2009
Bibliographic typeJournal article
Full text availabilityAvailable on request