Web Survey Bibliography
Grids have been the subject of significant research as a frequently used—but often problematic—way to present multiple questions in a shared layout, particularly within Web-based surveys. Respondents’ increasing use of mobile devices underscores and emphasizes the need to reexamine design standards for grids and questionnaires that will now be seen on a variety of screen types. While recent work has begun to explore the relationship between device use, data quality (McClain, Crawford, & Dugan, 2012; Saunders et al., 2012), and substantive responses (Mavletova & Couper, 2012), considerable practical concerns remain in conducting surveys that have been optimized for larger screens. Drawing upon recent literature and paradata that we have collected, we propose a combined layout and questionnaire design approach to confronting these challenges-- acknowledging that while refining layout and user design of grids can impact data quality (Couper et al., 2013) and aid mobile navigation, an additional challenge lies in designing questionnaires that are clear, cohesive, and adaptable to the smaller screen space available on mobile devices. To better understand interactions between device use and data quality measures in a grid-heavy setting, we reviewed respondent behavior and characteristics of grids from multi-year administrations of 11 Web surveys with college student populations, spanning several hundred thousand respondents. We focused our exploration on key contextual characteristics of grids that may influence data quality and exacerbate burden--such as questionnaire position/context, grid length and density, scale design, sensitivity of content, and presence of validations. Specifically, we investigate the relationship between several of these characteristics and mobile respondents’ tendency to straightline, as a potential indicator of satisficing (Krosnick, 1991); to break off; and to yield higher rates of item-missing data. Our presentation will highlight key findings from this analysis and discuss implications for questionnaire design that considers the mobile space.
Conference Homepage (abstract)
Web survey bibliography - Crawford, S. D. (25)
- The Effect of Mobile Web Survey Design on Screen Orientation Manipulation; 2014; Young, R.H.; Crawford, S. D.; Couper, M. P.; Nelson, T. F.
- Understanding Mobility: Consent and Capture of Geolocation Data in Web Surveys; 2014; Crawford, S. D.; McClain, C.; Young, R.H.; Nelson, T. F.
- Grid Formats, Data Quality, and Mobile Device Use: A Questionnaire Design Approach; 2013; McClain, C., Crawford, S. D.
- Examining the Feasibility of SMS as a Contact Mode for a College Student Survey; 2013; Crawford, S. D., McClain, C., O'Brien, S., Nelson, T. F.
- Web Survey Live Validations - What Are They Doing?; 2011; Crawford, S. D., McClain, C.
- Multi-Mode and Method Experiment in a Study of Nurses; 2010; Friese, C. R., Lee, C. S., O'Brien, S., Crawford, S. D.
- The Impact of Textual Messages of Encouragement on Web Survey Breakoffs: An Experiment ; 2009; Sakshaug, J. W., Crawford, S. D.
- Do Tailored Messages of Encouragement Reduce Web Survey Break-offs?; 2007; Sakshaug, J. W., Crawford, S. D., Inkelas, K. K.
- Web-Based Consent Form Design: An Experiment with Two Populations; 2006; Crawford, S. D., Eisenberg, D., Wimsatt, L., Golberstein, E.
- Using Interactive Web-Based Maps; 2006; Sinibaldi, J., Showen, S., Crawford, S. D., Saltz, R.
- The Social Science Web Survey System: Moving from 2.0 to 3.0; 2006; Crawford, S. D.
- Web Survey Design: Paging versus Scrolling; 2006; Peytchev, A., Couper, M. P., McCabe, S. E., Crawford, S. D.
- Unintended Consequences of Incentive Induced Response Rate Differences; 2005; Pope, D., Crawford, S. D., Johnson, E. O., McCabe, S. E.
- Using the Web to Survey College Students: Institutional Characteristics That Influence Survey Quality...; 2005; Crawford, S. D., McCabe, S. E., Inkelas, K. K.
- Mode effects for collecting alcohol and tobacco data among 3rd and 4th grade students: A randomized...; 2005; McCabe, S. E., Boyd, C. J., Young, A., Crawford, S. D., Pope, D.
- Developmnent and testing of web questionnaires; 2004; Baker, R. P., Crawford, S. D., Swinehart, J.
- Web Survey Design: Paging vs. Scrolling; 2004; Peytchev, A., Crawford, S. D., McCabe, S. E., Conrad, F. G., Couper, M. P.
- Validations in Web-based Surveys; 2003; Crawford, S. D., Peytchev, A.
- What They See Is What We Get: Response Options for Web Surveys; 2003; Couper, M. P., Tourangeau, R., Conrad, F. G., Crawford, S. D.
- The local/global decision in Internet research; 2002; Crawford, S. D., Jones, S., Rowen, C.
- Evaluation of Web Survey Data Collection Systems; 2002; Crawford, S. D.
- From Mail to Web: Improving Response Rates and Data Collection Efficiencies; 2002; Crawford, S. D., McCabe, S. E., Couper, M. P., Boyd, C. J.
- Testing Web Questionnaires; 2002; Crawford, S. D., Baker, R. P.
- A Nonresponse Analysis of a Mail-Web Mode Comparison; 2002; Boyd, C. J., Crawford, S. D., McCabe, S. E., Couper, M. P.
- Experiments on column width spacing in the University of Michigan Student Life Survey; 2001; Boyd, C. J., McCabe, S. E., Couper, M. P., Crawford, S. D.