Web Survey Bibliography
Question wording has long been known to influence responses. More recently, research has shown that the visual design of a questionnaire also influences responses (Smith 1995; Jenkins & Dillman 1997; Christian & Dillman 2004; Couper et al. 2004). In Smith’s original study, he found evidence that responses to a scalar question were influenced by the Dutch ladder visual aid provided with the question. Another somewhat common practice is to provide smiling and frowning faces in satisfaction scales. The faces are thought to act as a substantive symbolic language, helping respondents understand the meaning of scale points and negotiate through the scale, but we know very little about how respondents use the visual aids or what effect they have on responses. In this paper we use data from an eye tracking web experiment (n=62) conducted in Spring 2011 to examine the differences in respondents’ processing of and responses to satisfaction questions with and without smiley face visual aids. In particular, we look at total time to complete the questions, what parts of the questions respondents looked at, how long they looked at each part, and the order in which they looked at each part to try to better understand how visual aids such as smiley faces affect the processing of survey questions. Preliminary analyses indicate that those who received the smiley faces completed the question faster than those who did not receive the visual aid. Findings will help inform questionnaire design and contribute to the growing literature on how
visual elements affect survey processing and responses.
Conference Homepage (abstract)
Web survey bibliography - Smyth, J. D. (23)
- The Effect of CATI Questions, Respondents, and Interviewers on Response Time; 2016; Olson, K.; Smyth, J. D.
- Identifying predictors of survey mode preference; 2015; Millar, M. M.; Olson, K.; Smyth, J. D.
- Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method, 4th Edition; 2014; Dillman, D. A., Smyth, J. D., Christian, L. M.
- The Effect of Answering in a Preferred Versus a Non-Preferred Survey Mode on Measurement; 2014; Smyth, J. D., Olson, K., Kasabian, A.
- Assessing Within-Household Selection Methods in Household Mail Surveys; 2014; Olson, K., Stange, M., Smyth, J. D.
- Accuracy of Within-household Selection in Web and Mail Surveys of the General Population.; 2014; Olson, K., Smyth, J. D.
- Using Eye Tracking to Examine the Visual Design of Web Surveys; 2014; Zhou, Q., Ricci, K., Olson, K., Smyth, J. D.
- Are You Seeing What I am Seeing? Exploring Response Option Visual Design Effects With Eye-Tracking; 2013; Libman, A., Smyth, J. D., Olson, K.
- The effects of item saliency and question design on measurement error in a self-administered survey; 2012; Stern, M. J., D., Mendez, J. D.Smyth, J. D.
- Does Giving People Their Preferred Survey Mode Actually Increase Survey Participation Rates?; 2012; Olson, K., Smyth, J. D., Wood, H.
- Turn that Frown Upside-Down: The Effects of Smiley Faces as Symbolic Language in Self-administered Surveys...; 2012; Libman, A., Smyth, J. D.
- Literacy and Data Quality in Self-Administered Surveys; 2011; Smyth, J. D., Olson, K.
- Medium Node: NSF Census Research Network; 2011; McCutcheon, A. L., Belli, R. F., Olson, K., Smyth, J. D., Soh, L.-K.
- Using the Internet to Survey Small Towns and Communities: Limitations and Possibilities in the Early...; 2010; Smyth, J. D., Dillman, D. A., Christian, L. M., O'Neill, A. C.
- Response format effects on measurement of employment; 2009; Thomas, R. K., Dillman, D. A., Smyth, J. D.
- Open-Ended Questions in Web Surveys: Can Increasing the Size of Answer Boxes and Providing Extra Verbal...; 2009; Smyth, J. D., Dillman, D. A., Christian, L. M., McBride, M.
- ...; 2008; Dillman, D. A., Smyth, J. D., Christian, L. M., O'Neill, A. C.
- Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method ; 2008; Dillman, D. A., Christian, L. M., Smyth, J. D.
- Combining Mail and Internet Methods to Conduct Household Surveys of the General Public: A New Methodology...; 2008; Dillman, D. A., Smyth, J. D., Christian, L. M., Oneill, A.
- Context effects in Internet Surveys: New issues and evidence; 2007; Smyth, J. D., Dillman, D. A., Christian, L. M.
- Is it Possible to Obtain Equivalent Answers to Scalar Questions in Web and Telephone Surveys?; 2006; Christian, L. M., Dillman, D. A., Smyth, J. D.
- Open-Ended Questions in Web and Telephone Surveys; 2006; Smyth, J. D., Dillman, D. A., Christian, L. M., McBride, M.
- Comparing Check-All and Forced-Choice Question Formats in Web Surveys: The Role of Satisficing, Depth...; 2005; Smyth, J. D., Dillman, D. A., Christian, L. M., Stern, M. J.