Web Survey Bibliography
Title The Effect of Mobile Web Survey Design on Screen Orientation Manipulation
Author Young, R.H.; Crawford, S. D.; Couper, M. P.; Nelson, T. F.
Year 2014
Access date 16.08.2016
Presentation PDF (1,33 MB)
Abstract
Respondents are using mobile devices to complete web surveys whether we want them to or not. Because most web surveys are designed for larger screens, data quality may suffer, though little evidence exists to demonstrate whether or not this is the case. With on-board accelerometers, mobile devices can capture paradata to give us insight into respondent behavior.
To better evaluate whether specific web survey design features cause respondents to change how they hold their device we captured screen orientation, among other paradata. The assumption is that if the respondent rotates the device, it is to better view the survey. Capturing this information on a page-by-page basis throughout a survey provided sufficient data to understand if an orientation change (and change back) may have resulted from particular designs -- such as grid formatted questions.
We captured this paradata over multiple waves (of varying questionnaire length) to a college student survey fielded between mid-2013 and early 2014. While the survey was initially designed for larger screens, elements of mobile optimization were included for respondents accessing from a smartphone. In initially comparing optimized versus non-optimized designs, we see a significantly higher rate of respondents using landscape orientation on the non-optimized survey (approx. 20%) versus those on the optimized surveys (approx. 1%).
We will describe the respondent experience across multiple survey implementations, and we will discuss our hypotheses and further unveil the data that we have collected. Where possible, we will evaluate the data provided for quality (item missing data, breakoff, etc.) and will include device type and other interrelated variables in our analyses.
To better evaluate whether specific web survey design features cause respondents to change how they hold their device we captured screen orientation, among other paradata. The assumption is that if the respondent rotates the device, it is to better view the survey. Capturing this information on a page-by-page basis throughout a survey provided sufficient data to understand if an orientation change (and change back) may have resulted from particular designs -- such as grid formatted questions.
We captured this paradata over multiple waves (of varying questionnaire length) to a college student survey fielded between mid-2013 and early 2014. While the survey was initially designed for larger screens, elements of mobile optimization were included for respondents accessing from a smartphone. In initially comparing optimized versus non-optimized designs, we see a significantly higher rate of respondents using landscape orientation on the non-optimized survey (approx. 20%) versus those on the optimized surveys (approx. 1%).
We will describe the respondent experience across multiple survey implementations, and we will discuss our hypotheses and further unveil the data that we have collected. Where possible, we will evaluate the data provided for quality (item missing data, breakoff, etc.) and will include device type and other interrelated variables in our analyses.
Access/Direct link Conference Homepage (abstract) / (full tex)
Year of publication2014
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Crawford, S. D. (25)
- The Effect of Mobile Web Survey Design on Screen Orientation Manipulation; 2014; Young, R.H.; Crawford, S. D.; Couper, M. P.; Nelson, T. F.
- Understanding Mobility: Consent and Capture of Geolocation Data in Web Surveys; 2014; Crawford, S. D.; McClain, C.; Young, R.H.; Nelson, T. F.
- Grid Formats, Data Quality, and Mobile Device Use: A Questionnaire Design Approach; 2013; McClain, C., Crawford, S. D.
- Examining the Feasibility of SMS as a Contact Mode for a College Student Survey; 2013; Crawford, S. D., McClain, C., O'Brien, S., Nelson, T. F.
- Web Survey Live Validations - What Are They Doing?; 2011; Crawford, S. D., McClain, C.
- Multi-Mode and Method Experiment in a Study of Nurses; 2010; Friese, C. R., Lee, C. S., O'Brien, S., Crawford, S. D.
- The Impact of Textual Messages of Encouragement on Web Survey Breakoffs: An Experiment ; 2009; Sakshaug, J. W., Crawford, S. D.
- Do Tailored Messages of Encouragement Reduce Web Survey Break-offs?; 2007; Sakshaug, J. W., Crawford, S. D., Inkelas, K. K.
- Web-Based Consent Form Design: An Experiment with Two Populations; 2006; Crawford, S. D., Eisenberg, D., Wimsatt, L., Golberstein, E.
- Using Interactive Web-Based Maps; 2006; Sinibaldi, J., Showen, S., Crawford, S. D., Saltz, R.
- The Social Science Web Survey System: Moving from 2.0 to 3.0; 2006; Crawford, S. D.
- Web Survey Design: Paging versus Scrolling; 2006; Peytchev, A., Couper, M. P., McCabe, S. E., Crawford, S. D.
- Unintended Consequences of Incentive Induced Response Rate Differences; 2005; Pope, D., Crawford, S. D., Johnson, E. O., McCabe, S. E.
- Using the Web to Survey College Students: Institutional Characteristics That Influence Survey Quality...; 2005; Crawford, S. D., McCabe, S. E., Inkelas, K. K.
- Mode effects for collecting alcohol and tobacco data among 3rd and 4th grade students: A randomized...; 2005; McCabe, S. E., Boyd, C. J., Young, A., Crawford, S. D., Pope, D.
- Developmnent and testing of web questionnaires; 2004; Baker, R. P., Crawford, S. D., Swinehart, J.
- Web Survey Design: Paging vs. Scrolling; 2004; Peytchev, A., Crawford, S. D., McCabe, S. E., Conrad, F. G., Couper, M. P.
- Validations in Web-based Surveys; 2003; Crawford, S. D., Peytchev, A.
- What They See Is What We Get: Response Options for Web Surveys; 2003; Couper, M. P., Tourangeau, R., Conrad, F. G., Crawford, S. D.
- The local/global decision in Internet research; 2002; Crawford, S. D., Jones, S., Rowen, C.
- Evaluation of Web Survey Data Collection Systems; 2002; Crawford, S. D.
- From Mail to Web: Improving Response Rates and Data Collection Efficiencies; 2002; Crawford, S. D., McCabe, S. E., Couper, M. P., Boyd, C. J.
- Testing Web Questionnaires; 2002; Crawford, S. D., Baker, R. P.
- A Nonresponse Analysis of a Mail-Web Mode Comparison; 2002; Boyd, C. J., Crawford, S. D., McCabe, S. E., Couper, M. P.
- Experiments on column width spacing in the University of Michigan Student Life Survey; 2001; Boyd, C. J., McCabe, S. E., Couper, M. P., Crawford, S. D.