Web Survey Bibliography
Question wording has long been known to influence responses. More recently, research has shown that the visual design of a questionnaire also influences responses (Smith 1995; Jenkins & Dillman 1997; Christian & Dillman 2004; Couper et al. 2004). In Smith’s original study, he found evidence that responses to a scalar question were influenced by the Dutch ladder visual aid provided with the question. Another somewhat common practice is to provide smiling and frowning faces in satisfaction scales. The faces are thought to act as a substantive symbolic language, helping respondents understand the meaning of scale points and negotiate through the scale, but we know very little about how respondents use the visual aids or what effect they have on responses. In this paper we use data from an eye tracking web experiment (n=62) conducted in Spring 2011 to examine the differences in respondents’ processing of and responses to satisfaction questions with and without smiley face visual aids. In particular, we look at total time to complete the questions, what parts of the questions respondents looked at, how long they looked at each part, and the order in which they looked at each part to try to better understand how visual aids such as smiley faces affect the processing of survey questions. Preliminary analyses indicate that those who received the smiley faces completed the question faster than those who did not receive the visual aid. Findings will help inform questionnaire design and contribute to the growing literature on how
visual elements affect survey processing and responses.
Conference Homepage (abstract)
Web Survey Bibliography - Smyth, J. D. (32)
- The effects of item saliency and question design on measurement error in a self-administered survey; 2012; Stern, M. J., Smyth, J. D., Mendez, J.
- Does Giving People Their Preferred Survey Mode Actually Increase Survey Participation Rates?; 2012; Olson, K., Smyth, J. D., Wood, H.
- Turn that Frown Upside-Down: The Effects of Smiley Faces as Symbolic Language in Self-administered Surveys...; 2012; Libman, A., Smyth, J. D.
- Literacy and Data Quality in Self-Administered Surveys; 2011; Smyth, J. D., Olson, K.
- Medium Node: NSF Census Research Network; 2011; McCutcheon, A. L., Belli, R. F., Olson, K., D.; Smyth, J. D., Soh, L.-K.
- Internet Survey Methods: A Review of Strengths, Weaknesses, and Innovations; 2010; Smyth, J. D., Pearson, J. E.
- Using the Internet to Survey Small Towns and Communities: Limitations and Possibilities in the Early...; 2010; Smyth, J. D., Dillman, D. A., Christian, L. M., O'Neill, A. C.
- Response format effects on measurement of employment; 2009; Thomas, R. K., Dillman, D. A., Smyth, J. D.
- Open-Ended Questions in Web Surveys: Can Increasing the Size of Answer Boxes and Providing Extra Verbal...; 2009; Smyth, J. D., Dillman, D. A., Christian, L. M., McBride, M.
- ...; 2008; Dillman, D. A., Smyth, J. D., Christian, L. M., O'Neill, A. C.
- The Effects of Mode and Format on Answers to Scalar Questions in Telephone and Web Surveys; 2008; Christian, L. M., Dillman, D. A., D.Smyth, J. D.
- Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method ; 2008; Dillman, D. A., Christian, L. M., Smyth, J. D.
- Combining Mail and Internet Methods to Conduct Household Surveys of the General Public: A New Methodology...; 2008; Dillman, D. A., Smyth, J. D., Christian, L. M., Oneill, A.
- Does "Yes or No" on the Telephone Mean the Same as "Check-All-That-Apply" on the...; 2008; D., Christian, L. M., Dillman, D. A.Smyth, J. D.
- Context effects in Internet Surveys: New issues and evidence; 2007; D. Dillman, D. A., Christian, L. M., Smith, A.Smyth, J. D.
- Improving response quality in list-style open-ended questions in web and telephone surveys; 2007; Smyth, J. D., Dillman, D. A., Christian, L. M.
- Visual Design, Order Effects, and Respondent Characteristics in a Self-Administered Survey; 2007; Stern, M. J., Dillman, D. A., Smyth, J. D.
- Improving the Quality of Open-End Questions in Mail, Web, and Telephone Surveys; 2007; Dillman, D. A., Smyth, J. D.
- Design Effects in the Transition to Web-Based Surveys; 2007; Dillman, D. A., Smyth, J. D.
- Helping Respondents Get It Right the First Time: The Influence of Words, Symbols, and Graphics in Web...; 2007; Christian, L. M., Dillman, D. A., Smyth, J. D.
- Is it Possible to Obtain Equivalent Answers to Scalar Questions in Web and Telephone Surveys?; 2006; Christian, L. M., Dillman, D. A., Smyth, J. D.
- Open-Ended Questions in Web and Telephone Surveys; 2006; Smyth, J. D., Dillman, D. A., Christian, L. M., McBride, M.
- Effects of Using Visual Design Principles to Group Response Options in Web Surveys; 2006; Smyth, J. D., Dillman, D. A., Christian, L. M., Stern, M. J.
- Comparing Check-All and Forced-Choice Question Formats in Web Surveys; 2006; Smyth, J. D., Dillman, D. A., Christian, L. M., Stern, M. J.
- The Effects of Mode and Format on Answers to Scalar Questions in Telephone and Web Surveys; 2006; Christian, L. M., Dillman, D. A., Smyth, J. D.
- Does ‘Yes or No‘ on the Telephone Mean the Same as ‘Check-all-that-apply’ on...; 2006; Smyth, J. D., Christian, L. M., Dillman, D. A.
- Instructing Web and Telephone Respondents to Report Date Answers in Format Desired by the Surveyor; 2005; Christian, L. M., Dillman, D. A., Smyth, J. D.
- In Search of Equivalency across Modes: Experimental Results Comparing Alternative Question Formats for...; 2005; Christian, L. M., Dillman, D. A., Smyth, J. D.
- Comparing Check-All and Forced-Choice Question Formats in Web Surveys: The Role of Satisficing, Depth...; 2005; Smyth, J. D., Dillman, D. A., Christian, L. M., Stern, M. J.Chou, C.; de Rouvray, C.Christianson DeMay...
- How Visual Grouping Influences Answers To Internet Surveys; 2004; Smyth, J. D., Dillman, D. A., Christian, L. M., Stern, M. J.
- The Uses of Paradata for Evaluating Alternative Versions of Web Survey Questions; 2004; Dillman, D. A., Smyth, J. D., Christian, L. M., Stern, M. J.
- Multiple Answer Questions in Self-administered Surveys: The Use of Check-All-That-Apply and Forced-Choice...; 2003; Dillman, D. A., Smyth, J. D., Christian, L. M., Stern, M. J.