Notice: the WebSM website has not been updated since the beginning of 2018.

Web Survey Bibliography

Title Providing Clarifying Instructions in a Web Survey
Year 2011
Access date 30.06.2011
Abstract

Although comprehension is well recognized as a critical component of the survey question response process, much about it remains unknown. Past research has shown that ambiguous or vague concepts can be clarified through the use of definitions, instructions or examples, but respondents do not necessarily attend to these clarifications. The aim of this research was to investigate where and how to present clarifying information so that respondents would recognize it as essential to their answering survey questions correctly. The research questions were: does placing the clarification before a question, in the same font as the question, or incorporating the clarifications into a series of questions improve survey estimates? Eight study questions, modeled after major national surveys, were administered as part of a probability based Web survey (n = 913 completed interviews). The results suggest that respondents attended to the clarifying instructions. There is some evidence to suggest that in line with expectations, respondents anticipate the end of a question and are more likely to ignore clarification placed after a question than before. Respondents answer more quickly when the questions come after the question, suggesting they spend less time processing the clarification in this position, and their answers appear to be little less accurate. The practice of attempting to highlight the question through the use of font is not supported. However, as predicted, there is evidence to suggest that incorporating the clarifications into the questions and asking a series of questions is the most effective approach. Respondents answers appear to be the most accurate when this approach is employed.

Access/Direct link

Conference Homepage (abstract)

Year of publication2011
Bibliographic typeConferences, workshops, tutorials, presentations
Print