Web Survey Bibliography
Title The Uses of Paradata for Evaluating Alternative Versions of Web Survey Questions
Year 2004
Access date 11.06.2004
Abstract Procedures developed recently by Heerwegh (2003) make it possible to collect client-side paradata for all respondents to web surveys. It is possible through paradata to find out: 1) the time required for responding to each item, 2) whether any answers are changed by respondents, and 3) the order in which answers are provided to multiple answer questions (e.g. check-all items). In this paper we evaluate the use of paradata for understanding how alternative question designs affect respondents, and the strengths and weaknesses of each question format. Inasmuch as paradata may be collected from all respondents to a survey it has the potential of being another tool that will help researchers determine which question structures are most and least desirable for asking certain survey questions, thus complementing information about response distributions and that which might be gained from cognitive interviews. Four alternative question structures were developed for test items in an effort to understand how different visual layouts or designs affect respondent answers. Analysis of the paradata is aimed at helping to explain why and how different answer distributions are produced, and whether some formats appear easier to answer than do others. The overarching goal of this research is to be able to specify the strengths and limitations of this use of paradata for evaluating questions used in public opinion surveys.
Year of publication2004
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Christian, L. M. (21)
- User Experience and Eye-tracking: Results to Optimize Completion of a Web Survey and Website Design ; 2016; Walton, L.; Ricci, K.; Libman Barry, A.; Eiginger, C.; Christian, L. M.
- Evaluating Visual Design Elements for Data Collection and Panelist Engagement; 2015; Christian, L. M.; Harm, D.; Langer Tesfaye, C.; Wells, T.
- Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method, 4th Edition; 2014; Dillman, D. A., Smyth, J. D., Christian, L. M.
- A Comparison of Results from Surveys by the Pew Research Center and Google Consumer Surveys; 2012; Keeter, S., Christian, L. M.
- Assessing Cell Phone Noncoverage Bias Across Different Topics and Subgroups; 2010; Christian, L. M., Keeter, S., Purcell, K., Smith, A.
- Questionnaire Design Guidelines for Establishment Surveys; 2010; Morrison, R. L., Dillman, D. A., Christian, L. M.
- Using the Internet to Survey Small Towns and Communities: Limitations and Possibilities in the Early...; 2010; Smyth, J. D., Dillman, D. A., Christian, L. M., O'Neill, A. C.
- Where Do We Find You? How to Locate Cell Respondents; 2009; Christian, L. M., Dimock, M.
- Do Landline RDD Samples Adequately Cover the "Wireless Mostly"?; 2009; Dimock, M., Christian, L. M., Keeter, S.
- Open-Ended Questions in Web Surveys: Can Increasing the Size of Answer Boxes and Providing Extra Verbal...; 2009; Smyth, J. D., Dillman, D. A., Christian, L. M., McBride, M.
- The Influence of Topic Interest and Interactive Probing on Responses to Open-Ended Questions in Web...; 2009; Holland, J. L., Christian, L. M.
- Designing Scalar Questions for Web Surveys; 2009; Christian, L. M., Parsons, N. L., Dillman, D. A.
- ...; 2008; Dillman, D. A., Smyth, J. D., Christian, L. M., O'Neill, A. C.
- Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method ; 2008; Dillman, D. A., Christian, L. M., Smyth, J. D.
- Combining Mail and Internet Methods to Conduct Household Surveys of the General Public: A New Methodology...; 2008; Dillman, D. A., Smyth, J. D., Christian, L. M., Oneill, A.
- Context effects in Internet Surveys: New issues and evidence; 2007; Smyth, J. D., Dillman, D. A., Christian, L. M.
- The influence of interactive probing on response to open-ended questions in a web surveys; 2007; Holland, J. L., Christian, L. M.
- Is it Possible to Obtain Equivalent Answers to Scalar Questions in Web and Telephone Surveys?; 2006; Christian, L. M., Dillman, D. A., Smyth, J. D.
- Open-Ended Questions in Web and Telephone Surveys; 2006; Smyth, J. D., Dillman, D. A., Christian, L. M., McBride, M.
- Comparing Check-All and Forced-Choice Question Formats in Web Surveys: The Role of Satisficing, Depth...; 2005; Smyth, J. D., Dillman, D. A., Christian, L. M., Stern, M. J.
- The Influence of Graphical and Symbolic Language Manipulations on Responses to Self-Administered Questions...; 2004; Christian, L. M., Dillman, D. A.