Web Survey Bibliography
Satisfaction scales that employ symbolic images instead of text labels allow for greater comparability of responses across languages, eliminate survey translation burden, and avoid the ambiguity of purely numeric scales. However, little research has been done comparing "image-labeled" satisfaction scales with "text-labeled" scales. In this experiment, English-speaking respondents to a web-based customer satisfaction survey were randomly assigned to answer a series of three 7-point satisfaction questions in one of three ways: facial expression scales, text-labeled scales with labels at every point (running from "extremely dissatisfied" to "extremely satisfied"), or fully-labeled text scales with the addition of facial expressions at the end points only. This last condition was included to examine whether respondent transposition errors or primacy effects can be mitigated with a combined text/image scale. Key outcome measures were: the distribution of responses to the satisfaction questions, the correlation between a satisfaction question and questions measuring closely related constructs, and drop-off rates. For two of the three satisfaction questions, the facial expression scale produced average responses that were significantly lower (p<0.01) than either of the text-labeled scale conditions. Fewer respondents marked the top two categories of the facial expression scale than the scales with text-labeled points, producing a more dispersed and symmetrical distribution of responses. The facial expression scale also showed greater concurrent validity with questions measuring similar constructs than the two verbally-labeled scales. The two versions of the text-labeled scale produced nearly identical distributions of responses, and no significant differences in drop-off were found across the three conditions. Though results may vary depending on the specific verbal labels or images used, these findings suggest that a facial expression satisfaction scale can be equally or more valid than a text-labeled one while avoiding the burden of translation and the ambiguity of numeric scales.
Conference Homepage (abstract)
Web Survey Bibliography - The American Association for Public Opinion Research (AAPOR) 67th Annual Conference, 2012 (104)
- Encouraging Survey Response via Smartphones: Effects on Respondents’ Use of Mobile Devices and...; 2012; Dillman, D. A., Millar, M. M.
- When More Gets You Less: A Meta-Analysis of the Effect of Concurrent Web Options on Mail Survey Response...; 2012; Medway, R., Fulton, J.
- Panel Conditioning: Results from Two Experiments in a Probability-based Online Panel; 2012; Struminskaya, B., Kaczmirek, L., Schaurer, I., Bandilla, W.
- Testing Video Messages in Web Surveys: Effects on Sample Bias and Validity; 2012; Shapiro, D., Cappella, J.
- Ordering Your Attention: Response Order Effects in Parallel Phone and Online Surveys; 2012; Barlas, F. M., Thomas, R. K.
- Do Surveys that are Completed on Mobile Devices Differ from Surveys Completed Online, Over the Phone...; 2012; Gluck, A.
- A Direct Comparison of Mobile Versus Online Survey Modes; 2012; Wells, T., Bailey, J., Link, M. W.
- The Reliability and Validity of Alternative Customer Satisfaction Measurement Scales in PC Web and Mobile...; 2012; Chrzan, K., Saunders, T.
- Influencing Mode Choice in a Mixed Mode Survey; 2012; Mooney, G., Lan, F., Lin, X., Hurwitz, A.
- Developing a New Mixed Mode Methodology for a Provincial Park Camper Survey in British Columbia; 2012; Dyck, B. W., Dearden, P., Rollins, R.
- Nonresponse and Mode Effects in a Two-wave Randomized Mode Experiment; 2012; Beach, S., Musa, D.
- Are Multiple Modes Helpful? Balancing Reduction of Nonresponse and Sampling Error against Mode Effects...; 2012; Phillips, B. T., Harrison, C., Turakhia, C.
- Assessing the Mode-dependency of Survey Response and Non-response Bias; 2012; Klausch, L. T., Hox, J., Schouten, B.
- Question Order Effect: A Web Survey Experiment with Paradata; 2012; Ye, C., Tourangeau, R.
- Professional Respondents in Internet Panels: Who are They and What Do They Do to Our Data?; 2012; de Leeuw, E. D., Matthijsse, S.
- Designing an Instrument to Measure No-notice Emergency Evacuations: The Case of the Emergency Evacuation...; 2012; Bautista, R., Fontes, A., Auld, J., Sokolov, V.
- Using Text-to-Speech (TTS) for Audio-CASI; 2012; Couper, M. P., Kirgis, N., Buageila, S., Berglund, P.
- Auto vs. Manual Login Today: Updating Early Research; 2012; Crawford, S. D., McClain, C., Dugan, J. P.
- Using SMS Text Messaging To Collect Time Use Data; 2012; Brenner, P., DeLamater, J.
- A Shot in the Dark: Measurement Influence on Likelihood to Vaccination; 2012; Higgins, W. B., Thomas, R. K.
- Response Anchoring and Polarity Effects on Endorsement and Response Patterns; 2012; Higgins, W. B., Thomas, R. K.
- Update Your Status Lately? – Then Why Not Respond to Our Survey!; 2012; Borie-Holtz, D.
- Effects of Technical Difficulties on Item Nonresponse and Response Favorability in a Mixed-Mode Survey...; 2012; Gibson, J. L.
- Using Technology to Enhance the Quality of In-Depth Interview Data Collected by Telephone: A Study of...; 2012; Mulcahy, T. M., Nguyen, K., Brownstein, H., Johannes, F.-H.
- Evaluating the Impact of Emails and Landing Page on Web Survey Access; 2012; Falcone, A. E., Thomas, R. K., Mack, A. R.
- Order Manipulation of a Request to Validate Responses with Records in a Web Survey of Researchers; 2012; Burmeister, K., Osganian, S., de Ferranti, S., Denhoff, E., Stelz, S.
- Using Mixed-Mode Contacts to Facilitate Participation in Public Agency Client Surveys; 2012; Israel, G. D.
- Demonstration of the International Cross-Time, Cross-System Database; 2012; Miller, D.
- Demonstration of an Integrated Sample Management System for a Mixed Mode (Paper/Web) Survey; 2012; Ullman, E., Peng, H., Helppie McFall, B.
- Telephone Status, Attitudes toward Participation in Future Surveys, and Willingness to Join a Local...; 2012; Beach, S., Musa, D.
- Cell Sample Demographics under Alternative Dual-Frame Sample Designs; 2012; Montgomery, R., Morrison, H., Zeng, W., Wolter, K., Blumberg, S. J., O'Connor, K.
- Where is Neutral? Using Negativity Biases to Interpret Thermometer Scores; 2012; Soroka, S., Albaugh, Q.
- I Got a Feeling: Comparison of Feeling Thermometers with Verbally Labeled Scales in Attitude Measurement...; 2012; Thomas, R. K., Bremer, J.
- What Number of Scale Points in an Attitude Question Optimizes Response Validity and Administration Practicality...; 2012; Yeager, D. S., Anand, S., Krosnick, J. A.
- Making a Match: Exploring the Impact of Mode Preference on Measurement; 2012; Kasabian, A., Olson, K., Smyth, J.
- Question or Mode Effects in Mixed-Mode surveys: A Cross-cultural study in the Netherlands, Germany,...; 2012; de Leeuw, E. D., Nicolaas, G., Campanelli, P., Hox, J.
- Recruitment and Retention in Multi-Mode Survey Panels; 2012; McCutcheon, A. L., Rao, K., Kaminska, O.
- The Effect of Mixed Mode Designs on Nonresponse Bias; 2012; Wells, B. M., Olson, K.
- Demographic Question Placement and Its Effect on Item Response Rates and Means of a Veterans Health...; 2012; Teclaw, R., Price, M.Osatuke, K.
- Best Approaches to Mode Order and Non-response Prompting in a Multi-Mode Survey; 2012; Newsome, J., Levin, K., Schafer, B., Vigil, M., Liu, W.
- Using Online Panels for National Surveys of Low Incidence Populations: Findings from the CDC Influenza...; 2012; Boyle, J., Ball, S., Ding, H., Srinath, K. P., Euler, G.
- How Representative is a Self-selected Web-panel? - The Effect on Representation of Different Sampling...; 2012; Dahlberg, S., Martinsson, J., Lundmark, S.
- Using Probability-based On-line Samples to Calibrate Non-probability Opt-in Samples; 2012; DiSogra, C., Cobb, C. L., Chan, E., Dennis, J. M.
- Better (Quality), Faster, Cheaper? Completing Web Surveys on Cell-Enabled iPads; 2012; Driscoll, H., Dayton, J. J., Pels, R.
- Understanding Smartphone Usage to Take Web Surveys: A Cross Country Analysis; 2012; Stapleton, C.
- Scale Orientation, Number of Scale Points and Grids in Mobile Web Surveys; 2012; Chrzan, K.; Saunders, T., Jue, A.
- Use of Mobile Devices to Access Computer-optimized Web Instruments: Implications for Respondent Behavior...; 2012; McClain, C., Crawford, S. D., Dugan, J. P.
- Response Quality and Demographic Characteristics of Respondents Using a Mobile Device on a Web-based...; 2012; Guidry, K. R.
- Use of a 2nd Reminder Mailing, Quick Response Code and Optimized Mobile Survey to Increase Response...; 2012; Cantave, M. A., Gentry, R. J.
- The Effect on Differential Mailing Methodologies on Response Rates: Testing Advanced Notices, Package...; 2012; Pens, Y., Gentry, R. J.
