Web Survey Bibliography
Title The Impact of Survey Communications on Response Rates and Response Quality
Author Barlas, F. M.; Falcone, A. E.; Bellamy, N. D.; Mack, A. R.
Year 2013
Access date 23.08.2016
Full text PDF (312 KB)
Abstract
This paper investigates how efforts to improve response rates affect response quality in web surveys by assessing a number of indicators of quality. Response rates for all modes of survey administration have been declining in recent years and web-based surveys tend to have lower response rates than other administration modes. We conducted a survey to evaluate the services and supports provided by the Substance Abuse and Mental Health Services Administration’s (SAMHSA) Disaster Technical Assistance Center (DTAC). This study extends previous research that examined how the design of survey communication emails and landing page interact to affect survey response. The previous study found highest survey completion rates among those sent a long versus short email and presented with the web survey link at the top of the landing page versus the bottom. This may suggest respondents perceive survey burden only within the web survey interface and not the invitation email, and therefore may tolerate more information in email than on a landing page. The current study tests this by creating a 2x2 factorial design, where sample members are either presented the survey information needed for informed consent on a landing page (receiving a short email) or in an email (receiving a long email and bypassing the landing page), and either have the survey link/button presented at the top or bottom of the email communication. Maximizing survey response rates decreases the risk of nonresponse bias, helping to ensure that the survey will provide valid results. We compare response and completion rates and investigate whether the differences translate to variation in response quality by assessing response times, item non-response, patterns of systematic responses to grid questions, and use of the not applicable option when available. In addition we compared survey estimates across the four conditions to assess the impact on study findings.
Access/Direct link FCSM Research Conference Homepage (Abstract) / (Full text)
Year of publication2013
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Barlas, F. M. (11)
- Scientific Surveys Based on Incomplete Sampling Frames and High Rates of Nonresponse; 2016; Fahimi, M.; Barlas, F. M.; Thomas, R. K.; Buttermore, N. R.
- On the Go: How Mobile Participants Affect Survey Results; 2015; Barlas, F. M.; Thomas, R. K.
- The Matrix Lives On: Improving Grids for Online Surveys; 2015; Thomas, R. K.; Barlas, F. M.; Graham, P.; Subias, T.
- Purposefully Mobile: Experimentally Assessing Device Effects in an Online Survey ; 2015; Barlas, F. M.; Thomas, R. K.; Graham, P.
- Mobility Enabled: Effects of Mobile Devices on Survey Response and Substantive Measures; 2015; Barlas, F. M.; Randall, T. K.
- What They Can’t See Can Hurt You: Improving Grids for Mobile Devices; 2015; Randall, T. K.; Barlas, F. M.; Graham, P.; Subias, T.
- Respondents Playing Fast and Loose?: Antecedents and Consequences of Respondent Speed of Completion; 2014; Thomas, R. K., Barlas, F. M.
- The Impact of Survey Communications on Response Rates and Response Quality; 2013; Barlas, F. M.; Falcone, A. E.; Bellamy, N. D.; Mack, A. R.
- Alone in a Group: Comparison of Effects of a Group-Administered Paper-Pencil Survey Versus an Individually...; 2013; Higgins, W. B., Barlas, F. M., Pflieger, J., Thomas, R. K., Jeffery, D., Mattiko, M.
- Changing of the Guard: Effects of Different Self-Administered Survey Modes on Sensitive Questions; 2013; Barlas, F. M., Higgins, W. B., Pflieger, J., Thomas, R. K., Jeffery, D., Mattiko, M.
- An Injured Party?: A Comparison of Political Party Response Formats in Party Identification.; 2011; Schwarz, S., Barlas, F. M., Thomas, R. K., Corso, R. A., Szoc, R.