Web Survey Bibliography
Measurement of attitudes, opinions, and behavior in web surveys often relies on letting respondents indicate their agreement or disagreement with several statements on a continuum of predetermined answer categories on a horizontal rating scale presented in a grid format. When designing rating scales for web surveys, a number of decisions have to be made, among others about the response order of the scale points, i.e. whether the scale runs from positive to negative or from negative to positive. In the literature, there is no conclusive evidence about the influence of the direction of extreme point labeling (e.g., Belson, 1966; Christian et al. 2009; Dickson & Albaum 1975; Friedman et al., 1993; Weng & Cheng, 2000) and various theories have been used to explain differences in answer behavior; satisficing and primacy effects (Krosnick & Alwim 1987), interpretative heuristics (Tourangeau et al. 2004; 2007; Koller/Salzberger 2010), and cultural differences (Ferall-Nunge/Couper 2011; Tellis/Chandrasekaran 2010; Yang et al. 2010). As an increasing number of samples for web surveys is drawn from online panels and some respondents potentially participate in a large number of web surveys nowadays, their past experience with and expectations about the presentation of rating scales has to be considered. The presented study considers this diverse experience among web survey respondents. In three independent experiments with online panel members, professionals, and students the response order of rating scales was experimentally varied. The influence of scale direction was measured on different indicators of data quality (response distribution, answer differentiation, straightlining, response styles). The results indicate that respondents with more web survey experience assume that rating scales usually run from positive-to-negative.
Conference Homepage (abstract)
Web Survey Bibliography - USA (2159)
- The Effects of Errors in Paradata on Weighting Class Adjustments: A Simulation Study; 2013; West, B. T.
- Using Paradata to Study Response to Within-Survey Requests; 2013; Sakshaug, J. W.
- Paradata for Coverage Research ; 2013; Eckman, S.
- Improving Surveys with Paradata: Analytic Uses of Process Information; 2013; Kreuter, F.
- Theory of adaptation or survival of the fittest?; 2013; Cavallaro, K.
- Online Fundraising Essentials, Second Edition; 2013; Stevenson, S. C.
- Tips for Evaluating Online Effectiveness; 2013; Stevenson, S. C.
- The Digital Divide: The internet and social inequality in international perspective; 2013; Ragnedda, M., Muschert, G.
- Ten questions to ask your online survey provider; 2013; Williams, D.
- Survey quality prediction system 2.0; 2013
- Practical tools for designing and weighting survey samples; 2013; Valliant, R. L., Daver, J. A., Kreuter, F.
- Paradata in web surveys; 2013; Callegaro, M.
- Report Of The AAPOR Task Force On Non-probability sampling; 2013; Baker, R. P., Brick, J. M., Bates, N., Battaglia, M. P., Couper, M. P., Dever, J. A., Gile, K. J., Tourangeau...
- Mode Matters: Evaluating Response Comparability in a Mixed-Mode Survey; 2013; Bowyer, B. T., Rogowski, J. C.
- Methodological Considerations of Qualitative Email Interviews; 2013; Nehls, K.
- Best Practice in Online Survey Research with Sensitive Topics; 2013; Kays, K., Keith, T. L., Broughal, M. T.
- Using Web Surveys for Psychology Experiments: A Case Study in New Media Technology for Research; 2013; Peden, B. F., Tiry , A. M.
- Compared to a small, supervised lab experiment, a large, unsupervised web-based experiment on a previously...; 2013; Ryan, R. S., Wilde, M., Crist, S.
- Moving an established survey online – or not?; 2013; Barber, T., Chilvers, D., Kaul, S.
- On the Use of Latent Variable Models to Detect Differences in the Interpretation of Vague Quantifiers...; 2013; Griffin, J.
- Managing mobile research: How it's different and why it matters; 2013; Kachhi-Jiwani, D., Tucker, J., Wilding-Brown, L.
- An approach to selecting online respondents; 2013; Terhanian, G.
- By the Numbers: Theory of adaptation or survival of the fittest?; 2013; Cavallaro, K.
- Designing and conducting business surveys; 2013; Snijkers, G.,Araldsen, G., , Willimack, D. K.Jones, J.
- Battle of the Scales: Understanding Respondent Scale Usage in the US and Abroad; 2013; Courtright, M., Pashupati, K., Pettit, F. A.
- Modular Survey Design: A Bite Size Proposal; 2013; Kelly, F., Stevens, S., Johnson, A.
- Cyborgs vs. Monsters: Assembling Modular Surveys to Create Complete Datasets; 2013; Johnson, E. P., Siluk, L., Tarraf, S.
- Do I Have Your Full Attention?; 2013; Cape, P. J.
- Does Sample Size Still Matter?; 2013; Bakken, D. G., Bond, M.
- Optimizing Surveys for Smartphones: Maximizing Response Rates While Minimizing Bias; 2013; Lattery, K., Park Bartolone, G., Saunders, T.
- Shorter Isn't Always Better; 2013; Burdein, I.
- Solving the Unintentional Mobile Challenge; 2013; Peterson, G., Mechling, J., LaFrance, J., Ham, G.
- Mobile Research Risk: What Happens to Data Quality When Respondents Use a Mobile Device for a Survey...; 2013; Baker-Prewitt, J.
- Computer science security research and human subjects: Emerging considerations for research ethics boards...; 2013; Buchanan, E. A., Aycock, J., Dexter, S., Dittrich, D., Hvizdak, E. E.
- Addressing Survey Nonresponse Issues: Implications for ATE Principal Investigators, Evaluators, and...; 2013; Welch, W. W., Barlau, A. N.
- Addressing Disclosure Concerns and Analysis Demands in a Real-Time Online Analytic System; 2013; Krenzke, T., Gentleman, J. F., Li, J., Moriarity, C.
- The General Survey System Initiative at RTI International: An Integrated System for the Collection and...; 2013; Thalji, L., Mitchell, S., Hill, C. A., Suresh, R., Speizer, H., Pratt, D.
- Consolidation and Standardization of Survey Operations at a Decentralized Federal Statistical Agency; 2013; Nealon, J., Gleaton, E.
- Examination of the equivalence of self-report survey-based paper-and-pencil and internet data collection...; 2013; Weigold, A., Weigold, I. K., Russell, E. J.
- An Assessment of Incentive Versus Survey Length Trade-offs in a Web Survey of Radiologists; 2013; Ziegenfuss, J. Y., Niederhauser, B. D., Kallmes, D., Beebe, T. J.
- Clarifying Categorical Concepts in a Web Survey.; 2013; Redline, C. D.
- Using Online and Paper Surveys - The Effectiveness of Mixed-Mode Methodology for Populations Over 50; 2013; De Bernardo, D. H., Curtis, A.
- The Design of Grids in Web Surveys; 2013; Couper, M. P., Tourangeau, R., Conrad, F. G., Zhang, C.
- Survey Research; 2013; Abbott, M. L., McKinney, J.
- Understanding and Applying Research Design; 2013; Abbott, M. L., McKinney, J.
- The Science of Web Surveys; 2013; Tourangeau, R., Conrad, F. G., Couper, M. P.
- Virtual Research Methods; 2013; Hine, C.
- Informed Consent for Web Paradata Use; 2013; Couper, M. P., Singer, E.
- The Use of Mixed Methods in Organizational Communication Research; 2013; Salem, P. J.
- The Use of E-Questionnaires in Organizational Surveys; 2013; Brender-Ilan, Y., Vinitzky, G.
