Web Survey Bibliography
Measurement of attitudes, opinions, and behavior in web surveys often relies on letting respondents indicate their agreement or disagreement with several statements on a continuum of predetermined answer categories on a horizontal rating scale presented in a grid format. When designing rating scales for web surveys, a number of decisions have to be made, among others about the response order of the scale points, i.e. whether the scale runs from positive to negative or from negative to positive. In the literature, there is no conclusive evidence about the influence of the direction of extreme point labeling (e.g., Belson, 1966; Christian et al. 2009; Dickson & Albaum 1975; Friedman et al., 1993; Weng & Cheng, 2000) and various theories have been used to explain differences in answer behavior; satisficing and primacy effects (Krosnick & Alwim 1987), interpretative heuristics (Tourangeau et al. 2004; 2007; Koller/Salzberger 2010), and cultural differences (Ferall-Nunge/Couper 2011; Tellis/Chandrasekaran 2010; Yang et al. 2010). As an increasing number of samples for web surveys is drawn from online panels and some respondents potentially participate in a large number of web surveys nowadays, their past experience with and expectations about the presentation of rating scales has to be considered. The presented study considers this diverse experience among web survey respondents. In three independent experiments with online panel members, professionals, and students the response order of rating scales was experimentally varied. The influence of scale direction was measured on different indicators of data quality (response distribution, answer differentiation, straightlining, response styles). The results indicate that respondents with more web survey experience assume that rating scales usually run from positive-to-negative.
Conference Homepage (abstract)
Web Survey Bibliography - The American Association for Public Opinion Research (AAPOR) 67th Annual Conference, 2012 (104)
- Encouraging Survey Response via Smartphones: Effects on Respondents’ Use of Mobile Devices and...; 2012; Dillman, D. A., Millar, M. M.
- When More Gets You Less: A Meta-Analysis of the Effect of Concurrent Web Options on Mail Survey Response...; 2012; Medway, R., Fulton, J.
- Panel Conditioning: Results from Two Experiments in a Probability-based Online Panel; 2012; Struminskaya, B., Kaczmirek, L., Schaurer, I., Bandilla, W.
- Testing Video Messages in Web Surveys: Effects on Sample Bias and Validity; 2012; Shapiro, D., Cappella, J.
- Ordering Your Attention: Response Order Effects in Parallel Phone and Online Surveys; 2012; Barlas, F. M., Thomas, R. K.
- Do Surveys that are Completed on Mobile Devices Differ from Surveys Completed Online, Over the Phone...; 2012; Gluck, A.
- A Direct Comparison of Mobile Versus Online Survey Modes; 2012; Wells, T., Bailey, J., Link, M. W.
- The Reliability and Validity of Alternative Customer Satisfaction Measurement Scales in PC Web and Mobile...; 2012; Chrzan, K., Saunders, T.
- Influencing Mode Choice in a Mixed Mode Survey; 2012; Mooney, G., Lan, F., Lin, X., Hurwitz, A.
- Developing a New Mixed Mode Methodology for a Provincial Park Camper Survey in British Columbia; 2012; Dyck, B. W., Dearden, P., Rollins, R.
- Nonresponse and Mode Effects in a Two-wave Randomized Mode Experiment; 2012; Beach, S., Musa, D.
- Are Multiple Modes Helpful? Balancing Reduction of Nonresponse and Sampling Error against Mode Effects...; 2012; Phillips, B. T., Harrison, C., Turakhia, C.
- Assessing the Mode-dependency of Survey Response and Non-response Bias; 2012; Klausch, L. T., Hox, J., Schouten, B.
- Question Order Effect: A Web Survey Experiment with Paradata; 2012; Ye, C., Tourangeau, R.
- Professional Respondents in Internet Panels: Who are They and What Do They Do to Our Data?; 2012; de Leeuw, E. D., Matthijsse, S.
- Designing an Instrument to Measure No-notice Emergency Evacuations: The Case of the Emergency Evacuation...; 2012; Bautista, R., Fontes, A., Auld, J., Sokolov, V.
- Using Text-to-Speech (TTS) for Audio-CASI; 2012; Couper, M. P., Kirgis, N., Buageila, S., Berglund, P.
- Auto vs. Manual Login Today: Updating Early Research; 2012; Crawford, S. D., McClain, C., Dugan, J. P.
- Using SMS Text Messaging To Collect Time Use Data; 2012; Brenner, P., DeLamater, J.
- A Shot in the Dark: Measurement Influence on Likelihood to Vaccination; 2012; Higgins, W. B., Thomas, R. K.
- Response Anchoring and Polarity Effects on Endorsement and Response Patterns; 2012; Higgins, W. B., Thomas, R. K.
- Update Your Status Lately? – Then Why Not Respond to Our Survey!; 2012; Borie-Holtz, D.
- Effects of Technical Difficulties on Item Nonresponse and Response Favorability in a Mixed-Mode Survey...; 2012; Gibson, J. L.
- Using Technology to Enhance the Quality of In-Depth Interview Data Collected by Telephone: A Study of...; 2012; Mulcahy, T. M., Nguyen, K., Brownstein, H., Johannes, F.-H.
- Evaluating the Impact of Emails and Landing Page on Web Survey Access; 2012; Falcone, A. E., Thomas, R. K., Mack, A. R.
- Order Manipulation of a Request to Validate Responses with Records in a Web Survey of Researchers; 2012; Burmeister, K., Osganian, S., de Ferranti, S., Denhoff, E., Stelz, S.
- Using Mixed-Mode Contacts to Facilitate Participation in Public Agency Client Surveys; 2012; Israel, G. D.
- Demonstration of the International Cross-Time, Cross-System Database; 2012; Miller, D.
- Demonstration of an Integrated Sample Management System for a Mixed Mode (Paper/Web) Survey; 2012; Ullman, E., Peng, H., Helppie McFall, B.
- Telephone Status, Attitudes toward Participation in Future Surveys, and Willingness to Join a Local...; 2012; Beach, S., Musa, D.
- Cell Sample Demographics under Alternative Dual-Frame Sample Designs; 2012; Montgomery, R., Morrison, H., Zeng, W., Wolter, K., Blumberg, S. J., O'Connor, K.
- Where is Neutral? Using Negativity Biases to Interpret Thermometer Scores; 2012; Soroka, S., Albaugh, Q.
- I Got a Feeling: Comparison of Feeling Thermometers with Verbally Labeled Scales in Attitude Measurement...; 2012; Thomas, R. K., Bremer, J.
- What Number of Scale Points in an Attitude Question Optimizes Response Validity and Administration Practicality...; 2012; Yeager, D. S., Anand, S., Krosnick, J. A.
- Making a Match: Exploring the Impact of Mode Preference on Measurement; 2012; Kasabian, A., Olson, K., Smyth, J.
- Question or Mode Effects in Mixed-Mode surveys: A Cross-cultural study in the Netherlands, Germany,...; 2012; de Leeuw, E. D., Nicolaas, G., Campanelli, P., Hox, J.
- Recruitment and Retention in Multi-Mode Survey Panels; 2012; McCutcheon, A. L., Rao, K., Kaminska, O.
- The Effect of Mixed Mode Designs on Nonresponse Bias; 2012; Wells, B. M., Olson, K.
- Demographic Question Placement and Its Effect on Item Response Rates and Means of a Veterans Health...; 2012; Teclaw, R., Price, M.Osatuke, K.
- Best Approaches to Mode Order and Non-response Prompting in a Multi-Mode Survey; 2012; Newsome, J., Levin, K., Schafer, B., Vigil, M., Liu, W.
- Using Online Panels for National Surveys of Low Incidence Populations: Findings from the CDC Influenza...; 2012; Boyle, J., Ball, S., Ding, H., Srinath, K. P., Euler, G.
- How Representative is a Self-selected Web-panel? - The Effect on Representation of Different Sampling...; 2012; Dahlberg, S., Martinsson, J., Lundmark, S.
- Using Probability-based On-line Samples to Calibrate Non-probability Opt-in Samples; 2012; DiSogra, C., Cobb, C. L., Chan, E., Dennis, J. M.
- Better (Quality), Faster, Cheaper? Completing Web Surveys on Cell-Enabled iPads; 2012; Driscoll, H., Dayton, J. J., Pels, R.
- Understanding Smartphone Usage to Take Web Surveys: A Cross Country Analysis; 2012; Stapleton, C.
- Scale Orientation, Number of Scale Points and Grids in Mobile Web Surveys; 2012; Chrzan, K.; Saunders, T., Jue, A.
- Use of Mobile Devices to Access Computer-optimized Web Instruments: Implications for Respondent Behavior...; 2012; McClain, C., Crawford, S. D., Dugan, J. P.
- Response Quality and Demographic Characteristics of Respondents Using a Mobile Device on a Web-based...; 2012; Guidry, K. R.
- Use of a 2nd Reminder Mailing, Quick Response Code and Optimized Mobile Survey to Increase Response...; 2012; Cantave, M. A., Gentry, R. J.
- The Effect on Differential Mailing Methodologies on Response Rates: Testing Advanced Notices, Package...; 2012; Pens, Y., Gentry, R. J.
