Web Survey Bibliography
Title The Matrix Lives On: Improving Grids for Online Surveys
Author Thomas, R. K.; Barlas, F. M.; Graham, P.; Subias, T.
Year 2015
Access date 16.06.2016
Abstract
In self-administered surveys, grids have evolved to efficiently measure multiple concepts using the same graded response format across a number of different targets, with responses typically in columns and the rating targets to evaluate in rows. Generally, grids allow us to assess multiple targets more quickly than if each target is presented separately. However, grids have a number of issues, and in particular affect respondent experience on mobile devices - measurement in online surveys is generally limited by screen size. In a series of 3 studies with over 80,000 respondents in total, we present experiments that examined how reducing the number of grid response categories affects the measurement of a variety of concepts. We found that response formats with fewer response categories take less time to complete, are easier to complete on mobile platforms, and show as much validity as formats with more response categories. In addition, they also appear to detect smaller differences between rating targets than those with more response categories. This higher level of differentiation was unexpected, and we explore some reasons for this occurrence.
Access/Direct link Joint Statistical Meetings 2015
Year of publication2015
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Barlas, F. M. (11)
- Scientific Surveys Based on Incomplete Sampling Frames and High Rates of Nonresponse; 2016; Fahimi, M.; Barlas, F. M.; Thomas, R. K.; Buttermore, N. R.
- On the Go: How Mobile Participants Affect Survey Results; 2015; Barlas, F. M.; Thomas, R. K.
- The Matrix Lives On: Improving Grids for Online Surveys; 2015; Thomas, R. K.; Barlas, F. M.; Graham, P.; Subias, T.
- Purposefully Mobile: Experimentally Assessing Device Effects in an Online Survey ; 2015; Barlas, F. M.; Thomas, R. K.; Graham, P.
- Mobility Enabled: Effects of Mobile Devices on Survey Response and Substantive Measures; 2015; Barlas, F. M.; Randall, T. K.
- What They Can’t See Can Hurt You: Improving Grids for Mobile Devices; 2015; Randall, T. K.; Barlas, F. M.; Graham, P.; Subias, T.
- Respondents Playing Fast and Loose?: Antecedents and Consequences of Respondent Speed of Completion; 2014; Thomas, R. K., Barlas, F. M.
- The Impact of Survey Communications on Response Rates and Response Quality; 2013; Barlas, F. M.; Falcone, A. E.; Bellamy, N. D.; Mack, A. R.
- Alone in a Group: Comparison of Effects of a Group-Administered Paper-Pencil Survey Versus an Individually...; 2013; Higgins, W. B., Barlas, F. M., Pflieger, J., Thomas, R. K., Jeffery, D., Mattiko, M.
- Changing of the Guard: Effects of Different Self-Administered Survey Modes on Sensitive Questions; 2013; Barlas, F. M., Higgins, W. B., Pflieger, J., Thomas, R. K., Jeffery, D., Mattiko, M.
- An Injured Party?: A Comparison of Political Party Response Formats in Party Identification.; 2011; Schwarz, S., Barlas, F. M., Thomas, R. K., Corso, R. A., Szoc, R.