Web Survey Bibliography
Title Multiple Answer Questions in Self-administered Surveys: The Use of Check-All-That-Apply and Forced-Choice Question Formats
Year 2003
Access date 28.10.2004
Full text pdf (195k)
Abstract This paper reports results from a series of experimental manipulations of check-all-that-apply questions in an Internet survey. One purpose of the experiments was to determine whether reversing the order of the presentation of response options resulted in order effects, including primacy and anchoring. A second purpose was to determine the effects of converting check-all-that-apply guestions to a forced choice-format (e.g. Yes/No for each item). We found that the existence of order effects in check-all-that-apply questions appear to depend on whether questions require respondents to use temporarily or chronically accessible information, as has been previously reported for items requiring selection of only one response option. The conversion to a forced/choised format increased the percentage of respondents answering affirmatively to each response option. Aditionally, forced-choice formatted questions were unaffected by the use of more active answer categories (e.g. fan/not a fan) asw opposed to the common yes/no format. Finally the results from the survey of a random sample of 1503 University students, were quite similar to results from a previous mail survey experiment, suggesting that the response patterens observed in the current experiment result from self-administation in general, and not from a unique characteristic of web survey.
Access/Direct link Hompage - Dillman (full text)
Year of publication2003
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Christian, L. M. (21)
- User Experience and Eye-tracking: Results to Optimize Completion of a Web Survey and Website Design ; 2016; Walton, L.; Ricci, K.; Libman Barry, A.; Eiginger, C.; Christian, L. M.
- Evaluating Visual Design Elements for Data Collection and Panelist Engagement; 2015; Christian, L. M.; Harm, D.; Langer Tesfaye, C.; Wells, T.
- Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method, 4th Edition; 2014; Dillman, D. A., Smyth, J. D., Christian, L. M.
- A Comparison of Results from Surveys by the Pew Research Center and Google Consumer Surveys; 2012; Keeter, S., Christian, L. M.
- Assessing Cell Phone Noncoverage Bias Across Different Topics and Subgroups; 2010; Christian, L. M., Keeter, S., Purcell, K., Smith, A.
- Questionnaire Design Guidelines for Establishment Surveys; 2010; Morrison, R. L., Dillman, D. A., Christian, L. M.
- Using the Internet to Survey Small Towns and Communities: Limitations and Possibilities in the Early...; 2010; Smyth, J. D., Dillman, D. A., Christian, L. M., O'Neill, A. C.
- Where Do We Find You? How to Locate Cell Respondents; 2009; Christian, L. M., Dimock, M.
- Do Landline RDD Samples Adequately Cover the "Wireless Mostly"?; 2009; Dimock, M., Christian, L. M., Keeter, S.
- Open-Ended Questions in Web Surveys: Can Increasing the Size of Answer Boxes and Providing Extra Verbal...; 2009; Smyth, J. D., Dillman, D. A., Christian, L. M., McBride, M.
- The Influence of Topic Interest and Interactive Probing on Responses to Open-Ended Questions in Web...; 2009; Holland, J. L., Christian, L. M.
- Designing Scalar Questions for Web Surveys; 2009; Christian, L. M., Parsons, N. L., Dillman, D. A.
- ...; 2008; Dillman, D. A., Smyth, J. D., Christian, L. M., O'Neill, A. C.
- Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method ; 2008; Dillman, D. A., Christian, L. M., Smyth, J. D.
- Combining Mail and Internet Methods to Conduct Household Surveys of the General Public: A New Methodology...; 2008; Dillman, D. A., Smyth, J. D., Christian, L. M., Oneill, A.
- Context effects in Internet Surveys: New issues and evidence; 2007; Smyth, J. D., Dillman, D. A., Christian, L. M.
- The influence of interactive probing on response to open-ended questions in a web surveys; 2007; Holland, J. L., Christian, L. M.
- Is it Possible to Obtain Equivalent Answers to Scalar Questions in Web and Telephone Surveys?; 2006; Christian, L. M., Dillman, D. A., Smyth, J. D.
- Open-Ended Questions in Web and Telephone Surveys; 2006; Smyth, J. D., Dillman, D. A., Christian, L. M., McBride, M.
- Comparing Check-All and Forced-Choice Question Formats in Web Surveys: The Role of Satisficing, Depth...; 2005; Smyth, J. D., Dillman, D. A., Christian, L. M., Stern, M. J.
- The Influence of Graphical and Symbolic Language Manipulations on Responses to Self-Administered Questions...; 2004; Christian, L. M., Dillman, D. A.