Web Survey Bibliography
Increasingly colleges and universities use survey results to make decisions, inform research, and shape public opinion. Given the large number of surveys distributed on campuses, can researchers reasonably expect that busy respondents will diligently answer each and every question? Less serious respondents may “satisfice,” i.e., take short-cuts to conserve effort, in a number of ways—choosing the same response every time, skipping items, rushing through the instrument, or quitting early. In this paper we apply this satisficing framework to demonstrate analytic options for assessing respondents’ conscientiousness in giving high fidelity survey answers. Specifically, we operationalize satisficing as a series of measurable behaviors and compute a satisficing index for each survey respondent. Using data from two surveys administered in university contexts, we find that the majority of respondents engaged in satisficing behaviors, that single-item results can be significantly impacted by satisficing, and that scale reliabilities and correlations can be altered by satisficing behaviors. We conclude with a discussion of the importance of identifying satisficers in routine survey analysis in order to verify data quality prior to using results for decision-making, research, or public dissemination of findings.
Journal Homepage (abstract) / (full text)
Web Survey Bibliography - Research in Higher Education (11)
- Research staff and public engagement: a UK study; 2013; Davies, S.
- Hail to Thee, Our Alma Mater: Alumni Role Identity and the Relationship to Institutional Support Behaviors...; 2013; McDearmon, J. T.
- Nonresponse and Online Student Evaluations of Teaching: Understanding the Inﬂuence of Salience...; 2012; Adams, M. J. D., Umbach, P. D.
- Using the Theory of Satisficing to Evaluate the Quality of Survey Data ; 2012; Barge, S., Gehlbach, H.
- Can Lottery Incentives Boost Web Survey Response Rates? Findings from Four Experiments; 2011; Laguilles, J. S., Saunders, D. B., Williams, E. A.
- Student Survey Response Rates across Institutions: Why Do they Vary?; 2006; Porter, S. R., Umbach, P. D.
- Comparability of Data Gathered from Evaluation Questionnaires on Paper and Through the Internet; 2005; Leung, D., Kember, D.
- College Student Responses to Web and Paper Surveys: Does Mode Matter?; 2003; Hayek, J. C., Ouimet, J. A., Carini, R. M., Kennedy, J. M., Kuh, G. D.
- Assessing Response Rates And Nonresponse Bias In Web And Paper Surveys; 2003; Sax, L. J., Gilmartin, S. K., Bryant, A. N.
- The Impact of Lottery Incentives on Student Survey Response Rates; 2003; Whitcomb, M. E., Porter, S. R.
- Electronic versus traditional student ratings of instruction; 1999; Layne B. H., DeCristoforo, J. R., McGinty, D.