Web Survey Bibliography
Respondents follow simple heuristics in interpreting the visual features of questions. The authors carried out two experiments in two panels to investigate how the effect of visual heuristics affects the answers to survey questions. In the first experiment, the authors varied the distance between scale points in a 5-point scale to investigate whether respondents use the conceptual or visual midpoint of a scale. In the second experiment, the authors used different end point labels of a 5-point scale, by adding different shadings of color and numbers that differed both in sign and value (2 to -2), to study whether options that are similar of appearance are considered conceptually closer than when they are dissimilar in appearance. The authors predicted that there is a hierarchy of features that respondents attend to, with verbal labels taking precedence over numerical labels, and numerical labels taking precedence over visual cues. The results confirmed the hypothesis: the effect of spacing of response options and different end points was only apparent in polar point scales and not in fully labeled scales. In addition, this study on two panels, with one consisting of extremely trained respondents and the other of relatively fresh respondents, shows that trained respondents are affected by the distance between response options whereas relatively new respondents are not. To reduce the effect of visual cues, taking into account the robustness of results, the authors suggest it is better to use fully labeled 5-point scales in survey questions.
Journal Homepage (abstract) / (full text)
Web Survey Bibliography - Toepoel, V. (23)
- Effects of Incentives in Surveys; 2012; Toepoel, V.
- Building Your Own Online Panel Via E-Mail and Other Digital Media; 2012; Toepoel, V.
- Recruiting A Probability Sample For An Online Panel: Effects Of Contact Mode, Incentives, And Information...; 2012; Scherpenzeel, A., Toepoel, V.
- Panel Recruitment via Facebook; 2011; Toepoel, V.
- Nonparametric Tests of Panel Conditioning and Attrition Bias in Panel Surveys; 2011; Das, M., Toepoel, V., van Soest, A.
- Discussion: "Conducting Respondent Driven Sampling on the Web: An Experimental Approach to Recruiting...; 2011; Toepoel, V.
- Response Quantity, Response Quality, and Costs of Building an Online Panel via Social Contacts.; 2011; Toepoel, V.
- Can Verbal Instructions Counteract Visual Context Effects in Web Surveys?; 2011; Toepoel, V., Couper, M. P.
- Words, Numbers, and Visual Heuristics in Web Surveys: Is There a Hierarchy of Importance?; 2011; Toepoel, V., Dillman, D. A.
- How Visual Design Affects the Interpretability of Survey Questions; 2010; Toepoel, V., Dillman, D. A.
- Words, Numbers and Visual Heuristics in Web Surveys: Is There a Hierarchy of Importance?; 2009; Toepoel, V., Dillman, D. A.
- Design of Web Questionnaires: The Effect of Layout in Rating Scales; 2009; Toepoel, V., Das, M., van Soest, A.
- Relating Question Type to Panel Conditioning: A comparison between trained and fresh respondents; 2009; Toepoel, V., Das, M., van Soest, A.
- Pictures in Web Surveys; 2009; Toepoel, V., Couper, M. P.
- Panel Conditioning in Web Surveys: A Comparison between Trained and Fresh Respondents; 2009; Toepoel, V., Das, M., van Soest, A.
- Visual Heuristics and Answer Formats in Rating Scales; 2009; Toepoel, V. Dillman, D. A.
- Relating Question Type to Panel Conditioning: Comparing Trained and Fresh Respondents; 2009; Toepoel, V., Das, M., van Soest, A.
- Design of Web Questionnaires: The Effects of the Number of Items per Screen; 2009; Toepoel, V., Das, M., van Soest, A.
- Effects of Design in Web Surveys: Comparing Trained and Fresh Respondents ; 2009; Toepoel, V., Das, M., van Soest, A.
- Design of Web Questionnaires: An Information-Processing Perspective for the Effect of Response Categories...; 2009; Toepoel, V., Vis, C., Das, M., van Soest, A.
- Design effects in web surveys: comparing trained and fresh respondents; 2008; Toepoel, V., Das, M., van Soest, A.
- Can I use a panel? Panel conditioning and attrition bias in panel surveys; 2007; Das, M., Toepoel, V., van Soest, A.
- Design of Web Questionnaires: The Effect of Layout in Rating Scales ; 2006; Toepoel, V., Das, M., van Soest, A.