Web Survey Bibliography
Attitude measurement in web surveys mostly relies on requiring respondents to indicate their agreement or disagreement with each of several items under the same Likert-type scale in a grid format. As it is known that respondents do not only attend to the words that convey the questions but also to the visual language of a questionnaire (i.e., format and shape of response scales, verbal and numerical labels of scale points, spacing, positioning, and order of response options) it is essential to understand how this effects the response process. Although there is no conclusive evidence about the influence of the direction of extreme point labeling (e.g., Belson, 1966; Friedman et al., 1993; Salzberger & Koller, 2010; Weng & Cheng, 2000), applying the ―near means related‖ heuristic (Tourangeau et al., 2004; 2007) to horizontal Likert-type scales would suggest that the proximity between the item and the positive anchor of the scale in a agree-to-disagree format would lead to different results than a reversed scale (disagree-toagree format). This study aims to bring forward how the direction of Likert-type scales in grid formats influences the response behavior of different respondent groups. In two independent web surveys with online panel members and professionals respondents were assigned to one of four treatment groups. The direction of Likert-type scales as well as the use of numerical labeling of scale points was experimentally varied in a full-factorial 2 (agree-to-disagree vs. disagree-to-agree) x 2 (with numerical labels vs. without numerical labels) design. The influence of scale presentation was measured on different indicators of data quality (response latency, item omission, non-differentiation in grids, response sets).
AAPOR Homepage (abstract)
GOR Homepage (abstract) / (presentation)
Web survey bibliography - General Online Research Conference (GOR) 2011 (17)
- Sampling v. Scale: An investigation the tension between convenience sampling, response rates, probability...; 2011; Garland, P.
- Effectiveness and consequences of various recruitment methods in psychological research: case study; 2011; Poltorak, M.
- A new approach to the analysis of survey drop-out. Results from Follow-up Surveys in the German Longitudinal...; 2011; Rossmann, J., Blumenstiel, J. E., Steinbrecher, M.
- Tracking the decision-making process – Findings from an Online Rolling Cross-Section Panel Study...; 2011; Faas, T.
- Should we use the progress bar in online surveys? A meta-analysis of experiments manipulating progress...; 2011; Callegaro, M., Yang, Y., Villar, A.
- From "Web Questions" to "Propensity Score Weighting": An Evaluation of Topics and...; 2011; Welker, M., Taddicken, M.
- Rich Profiles – Or: What's the problem with self-disclosure data?; 2011; Tress, F.
- Who are leaving our panel: panel attrition and personality traits; 2011; Marchand, M.
- Mobile Research Apps – Adding New Capabilities to Market Research; 2011; Rieber, D.
- The influence of personality traits and motives for joining on participation behavior in online panels...; 2011; Keusch, F.
- Asking sensitive questions in a recruitment interview for an online panel: the income question; 2011; Schaurer, I., Struminskaya, B., Kaczmirek, L., Bandilla, W.
- Speeders in Online Value Research: Cross-checking results of fast and slow respondents in two separate...; 2011; Beckers, T., Siegers, P., Kuntz, A.
- Effects of survey question clarity on data quality; 2011; Lenzner, T.
- Respondent Characteristics as Explanations for Uninformative Survey Response: Sources of Nondifferentiation...; 2011; Van Meurs, L., Klausch, L. T., Schoenbach, K.
- Response Quantity, Response Quality, and Costs of Building an Online Panel via Social Contacts.; 2011; Toepoel, V.
- The Influence Of The Direction Of Likert-Type Scales In Web Surveys On Response Behavior In Different...; 2011; Keusch, F.
- Social desirability and self-reported health risk behaviors in web-based research: three longitudinal...; 2010; Crutzen, R., Goeritz, A.