Web Survey Bibliography
Questionnaire development and testing for traditional paper and pencil questionnaires have tended to focus on the key elements of question type selection, wording, and order. Where self-administration is used, graphic design is also important. The transition to computer-assisted methods has added a new set of concerns, namely technical correctness (e.g., branching, calculations, text fills, etc.) and, more recently, usability.
The advent of web-based interviewing has further complicated the questionnaire development and testing phases of survey design and implementation. We now face new concerns about web-based communication styles, unique question types and formats, screen layout and use of color, added complexity to tests of technical correctness, and technical performance (e.g., speed of page delivery, appearance under different browsers, etc.).
This paper describes a series of testing protocols for Web questionnaires. It conceives of a Web questionnaire as having six main components: presentation, instructions and questions, logic and functionality, respondent environment, application software, and hosting platform. Effective testing requires that each of these components be evaluated and tested individually, as well as a thorough test of the assembled whole. The type of testing done and its point in the lifecycle of survey design and implementation will vary by component. In developing these protocols the authors draw on the survey methods literature, the literature on software testing, and their own experience both testing computer-based questionnaires and deploying hundreds of Web surveys.
Homepage - conference (abstract)
Web survey bibliography - Crawford, S. D. (25)
- The Effect of Mobile Web Survey Design on Screen Orientation Manipulation; 2014; Young, R.H.; Crawford, S. D.; Couper, M. P.; Nelson, T. F.
- Understanding Mobility: Consent and Capture of Geolocation Data in Web Surveys; 2014; Crawford, S. D.; McClain, C.; Young, R.H.; Nelson, T. F.
- Grid Formats, Data Quality, and Mobile Device Use: A Questionnaire Design Approach; 2013; McClain, C., Crawford, S. D.
- Examining the Feasibility of SMS as a Contact Mode for a College Student Survey; 2013; Crawford, S. D., McClain, C., O'Brien, S., Nelson, T. F.
- Web Survey Live Validations - What Are They Doing?; 2011; Crawford, S. D., McClain, C.
- Multi-Mode and Method Experiment in a Study of Nurses; 2010; Friese, C. R., Lee, C. S., O'Brien, S., Crawford, S. D.
- The Impact of Textual Messages of Encouragement on Web Survey Breakoffs: An Experiment ; 2009; Sakshaug, J. W., Crawford, S. D.
- Do Tailored Messages of Encouragement Reduce Web Survey Break-offs?; 2007; Sakshaug, J. W., Crawford, S. D., Inkelas, K. K.
- Web-Based Consent Form Design: An Experiment with Two Populations; 2006; Crawford, S. D., Eisenberg, D., Wimsatt, L., Golberstein, E.
- Using Interactive Web-Based Maps; 2006; Sinibaldi, J., Showen, S., Crawford, S. D., Saltz, R.
- The Social Science Web Survey System: Moving from 2.0 to 3.0; 2006; Crawford, S. D.
- Web Survey Design: Paging versus Scrolling; 2006; Peytchev, A., Couper, M. P., McCabe, S. E., Crawford, S. D.
- Unintended Consequences of Incentive Induced Response Rate Differences; 2005; Pope, D., Crawford, S. D., Johnson, E. O., McCabe, S. E.
- Using the Web to Survey College Students: Institutional Characteristics That Influence Survey Quality...; 2005; Crawford, S. D., McCabe, S. E., Inkelas, K. K.
- Mode effects for collecting alcohol and tobacco data among 3rd and 4th grade students: A randomized...; 2005; McCabe, S. E., Boyd, C. J., Young, A., Crawford, S. D., Pope, D.
- Developmnent and testing of web questionnaires; 2004; Baker, R. P., Crawford, S. D., Swinehart, J.
- Web Survey Design: Paging vs. Scrolling; 2004; Peytchev, A., Crawford, S. D., McCabe, S. E., Conrad, F. G., Couper, M. P.
- Validations in Web-based Surveys; 2003; Crawford, S. D., Peytchev, A.
- What They See Is What We Get: Response Options for Web Surveys; 2003; Couper, M. P., Tourangeau, R., Conrad, F. G., Crawford, S. D.
- The local/global decision in Internet research; 2002; Crawford, S. D., Jones, S., Rowen, C.
- Evaluation of Web Survey Data Collection Systems; 2002; Crawford, S. D.
- From Mail to Web: Improving Response Rates and Data Collection Efficiencies; 2002; Crawford, S. D., McCabe, S. E., Couper, M. P., Boyd, C. J.
- Testing Web Questionnaires; 2002; Crawford, S. D., Baker, R. P.
- A Nonresponse Analysis of a Mail-Web Mode Comparison; 2002; Boyd, C. J., Crawford, S. D., McCabe, S. E., Couper, M. P.
- Experiments on column width spacing in the University of Michigan Student Life Survey; 2001; Boyd, C. J., McCabe, S. E., Couper, M. P., Crawford, S. D.