Web Survey Bibliography
Title The Influence of Visual Layout on Scalar Questions in Web Surveys
Author Christian, L. M.
Year 2004
Access date 16.09.2004
Abstract This paper examines how the visual presentation of response choices influences answers to ordinal scale questions and extends previous experimentation on paper surveys to the Internet, to determine whether the results of varying scale layouts are similar or different. The web survey of a random sample of Washington State University students during Spring 2003 included two sets of experimental comparisons; 1591 completed surveys were submitted from the 3004 requested obtaining a response rate of 53%. One experiment included a response scale with all categories labeled and compared a vertical linear layout using four-five categories to three nonlinear layouts where categories were double- or triple-banked in columns across the page. A second set of experiments compared 5- and 6-point fully labeled scales to polar point scales where the verbal labels were removed for the middle three categories to an answer box format where respondents reported a number in an answer space. Multiple replications of each experiment indicate significant differences in the means between formats as well as significantly different response distributions. These findings on the web tend to confirm previous findings on paper questionnaires and suggest that respondents to both paper and web surveys are similarly affected by visual layout and presentation (Christian and Dillman, In Press, Public Opinion Quarterly, Spring 2004). Strong evidence now exists, that the visual presentation and layout of response scales influence respondent answers to self-administered questionnaires and need to be considered when designing public opinion questions and surveys that use ordinal scale questions. These construction differences appear to be important in helping surveyors understand why responses may vary across modes. The increasing use of mixed-mode surveys suggests the need to understand how the mode of communication, visual or aural, can influence how surveyors design questions and how respondents answer those questions.
Year of publication2004
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Christian, L. M. (21)
- User Experience and Eye-tracking: Results to Optimize Completion of a Web Survey and Website Design ; 2016; Walton, L.; Ricci, K.; Libman Barry, A.; Eiginger, C.; Christian, L. M.
- Evaluating Visual Design Elements for Data Collection and Panelist Engagement; 2015; Christian, L. M.; Harm, D.; Langer Tesfaye, C.; Wells, T.
- Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method, 4th Edition; 2014; Dillman, D. A., Smyth, J. D., Christian, L. M.
- A Comparison of Results from Surveys by the Pew Research Center and Google Consumer Surveys; 2012; Keeter, S., Christian, L. M.
- Assessing Cell Phone Noncoverage Bias Across Different Topics and Subgroups; 2010; Christian, L. M., Keeter, S., Purcell, K., Smith, A.
- Questionnaire Design Guidelines for Establishment Surveys; 2010; Morrison, R. L., Dillman, D. A., Christian, L. M.
- Using the Internet to Survey Small Towns and Communities: Limitations and Possibilities in the Early...; 2010; Smyth, J. D., Dillman, D. A., Christian, L. M., O'Neill, A. C.
- Where Do We Find You? How to Locate Cell Respondents; 2009; Christian, L. M., Dimock, M.
- Do Landline RDD Samples Adequately Cover the "Wireless Mostly"?; 2009; Dimock, M., Christian, L. M., Keeter, S.
- Open-Ended Questions in Web Surveys: Can Increasing the Size of Answer Boxes and Providing Extra Verbal...; 2009; Smyth, J. D., Dillman, D. A., Christian, L. M., McBride, M.
- The Influence of Topic Interest and Interactive Probing on Responses to Open-Ended Questions in Web...; 2009; Holland, J. L., Christian, L. M.
- Designing Scalar Questions for Web Surveys; 2009; Christian, L. M., Parsons, N. L., Dillman, D. A.
- ...; 2008; Dillman, D. A., Smyth, J. D., Christian, L. M., O'Neill, A. C.
- Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method ; 2008; Dillman, D. A., Christian, L. M., Smyth, J. D.
- Combining Mail and Internet Methods to Conduct Household Surveys of the General Public: A New Methodology...; 2008; Dillman, D. A., Smyth, J. D., Christian, L. M., Oneill, A.
- Context effects in Internet Surveys: New issues and evidence; 2007; Smyth, J. D., Dillman, D. A., Christian, L. M.
- The influence of interactive probing on response to open-ended questions in a web surveys; 2007; Holland, J. L., Christian, L. M.
- Is it Possible to Obtain Equivalent Answers to Scalar Questions in Web and Telephone Surveys?; 2006; Christian, L. M., Dillman, D. A., Smyth, J. D.
- Open-Ended Questions in Web and Telephone Surveys; 2006; Smyth, J. D., Dillman, D. A., Christian, L. M., McBride, M.
- Comparing Check-All and Forced-Choice Question Formats in Web Surveys: The Role of Satisficing, Depth...; 2005; Smyth, J. D., Dillman, D. A., Christian, L. M., Stern, M. J.
- The Influence of Graphical and Symbolic Language Manipulations on Responses to Self-Administered Questions...; 2004; Christian, L. M., Dillman, D. A.