Web Survey Bibliography
Title The Impact of Scale Direction, Alignment and Length on Responses to Rating Scale Questions in a Web Survey
Author Keusch, F.; Liu, M.; Yan, T.
Year 2016
Access date 01.06.2016
Abstract
Although rating scale questions are used extensively in surveys and have received much research attention in the literature, the direction of the rating scales has not been as extensively studied as have other design features. Previous research found mean shifts and changes in proportions endorsing various response options under different scale directions, indicating that respondents are more likely to select response options at the start of the scale, regardless of whether the response options are presented in an ascending order (i.e., the scale runs from the positive pole or highest level to the negative pole or lowest level) or descendingorder (i.e., running from the negative pole or lowest level to the positive pole or highest level). However, it is not quite clear yet, whether this effect is independent of other scale features, such as alignment of the scale (i.e., whether the scale is presented vertically or horizontally) and the number of scale points. Also more research is needed on the influence of scale direction on other properties of the resulting answers (e.g., factor structures, internal consistency of resulted factors). In two experiments in a nonprobability online panel, respondents were randomly assigned to answer two sets of multi-item batteries (4 items on traditionalism and 4 items on political efficacy) on a descending scale or an ascending scale. Preliminary analyses confirms that the scale direction significantly affects resultant survey responses by pushing answers to the beginning of the scale. We found that scale alignment (vertical vs. horizontal presentation of the scale) and number of scale points (5-point vs. 7-point) does not interact with scale direction but that respondents who speeded through the questionnaire were particularly prone to the scale direction effect. Further analysis will focus on the influence of scale direction on factors structure and internal consistency of the resulted factors.
Access/Direct link Conference Homepage (abstract)
Year of publication2016
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Keusch, F. (21)
- Web Survey Gamification - Increasing Data Quality in Web Surveys by Using Game Design Elements; 2017; Schacht, S.; Keusch, F.; Bergmann, N.; Morana, S.
- The Impact of Response Scale Direction on Survey Responses in a Mixed-mode Survey ; 2016; Hu, M.; Yan, T.; Keusch, F.
- The Impact of Scale Direction, Alignment and Length on Responses to Rating Scale Questions in a Web...; 2016; Keusch, F.; Liu, M.; Yan, T.
- A Review of Issues in Gamified Surveys; 2015; Keusch, F.; Zhang, Che.
- Understanding Society Innovation Panel Wave 7: Results from Methodological Experiments; 2015; Blom, A. G.; Burton, J.; Booker, C. L.; Cernat, A.; Fairbrother, M.; Jaeckle, A.; Kaminska, O.; Keusch...
- Impact of response scale direction on survey responses in web and mobile web surveys; 2015; Yan, T.; Keusch, F.
- The Effects of the Direction of Rating Scales on Survey Responses in a Telephone Survey; 2015; Keusch, F., Yan, T.
- The Influence of Answer Box Format on Response Behavior on List-Style Open-Ended Questions; 2014; Keusch, F.
- Motives for joining nonprobability online panels and their association with survey participation behavior...; 2014; Keusch, F., Batinic, B., Mayerhofer, W.
- The Influence of Answer Box Format, Personal Topic Interest, and Respondent Characteristics on Response...; 2013; Keusch, F.
- The Direction of Rating Scales and Its Influence on Response Behavior in Web Surveys; 2012; Keusch, F.
- Open-ended Questions in Web Surveys: One Large vs. Ten Small Boxes; 2012; Keusch, F.
- The influence of social desirability on data quality in face-to-face and web surveys; 2012; Keusch, F.
- The influence of personality traits and motives for joining on participation behavior in online panels...; 2011; Keusch, F.
- Does the direction of Likert-type scales influence response behavior in web surveys?; 2011; Keusch, F.
- The Influence Of The Direction Of Likert-Type Scales In Web Surveys On Response Behavior In Different...; 2011; Keusch, F.
- Does Making The Survey Topic More Salient Lead To An Expert Bias? – The Influence of Announcing...; 2010; Keusch, F., Mayerhofer, W., Weilbuchner, N., Jungreithmaier, S.
- Online Access Panels: A detailed look at different Ways of Entering, their Costs and Participation Behavior...; 2010; Führer, R., Keusch, F.
- Can a professional questionnaire layout make up for a boring topic? The mediating role of topic interest...; 2010; Keusch, F., Mayerhofer, W., Jungreithmaier, S., Weilbuchner, N., Fuehrer, R., Kling, H.
- Maßnahmen zur Steigerung der Responserate bei listenbasierten Stichproben in Webbefragungen; 2009; Keusch, F.
- Increasing response rates in list based samples; 2009; Keusch, F., Kurz, H., Penzkofer, P.