Web Survey Bibliography
Title Comparability of Data Gathered from Evaluation Questionnaires on Paper and Through the Internet
Source Research in Higher Education, 46, 5, pp. 571-591
Database Ingenta Select
Access date 25.07.2005
Abstract Collecting feedback from students through course, program and other evaluation questionnaires has become a costly and time consuming process for most colleges. Converting to data collection through the internet, rather than completion on paper, can result in a cheaper and more efficient process. This article examines several research questions which need to be answered to establish that results collected by the two modes of administration are equivalent. Data were gathered for a program evaluation questionnaire from undergraduate students at a university in Hong Kong. Students were able to choose between completion on paper or through the internet. In six of the seven Faculties the number of responses through each mode was roughly the same. Students in the Engineering Faculty favored the internet. Scores on the 14 out of 18 scales in the instrument showed small differences by mode of response, which became smaller still with controls for pertinent demographic variables. The main response question addressed in the study was whether there was any difference in the way respondents to the two modes interpreted the questions. The study demonstrated the equivalence of the two data sets by showing that both could be fitted to a common model with structural equation modeling (SEM). Five levels of tests of invariance further confirmed the comparability of data by mode of administration. This study, therefore suggests that changing to internet collection for course and program evaluations will not affect the comparability of ratings.
Access/Direct link Database (abstract)
Year of publication2005
Bibliographic typeJournal article
Web Survey Bibliography - Research in Higher Education (9)
- Nonresponse and Online Student Evaluations of Teaching: Understanding the Inﬂuence of Salience...; 2012; Adams, M. J. D., Umbach, P. D.
- Using the Theory of Satisficing to Evaluate the Quality of Survey Data ; 2012; Barge, S., Gehlbach, H.
- Can Lottery Incentives Boost Web Survey Response Rates? Findings from Four Experiments; 2011; Laguilles, J. S., Saunders, D. B., Williams, E. A.
- Student Survey Response Rates across Institutions: Why Do they Vary?; 2006; Porter, S. R., Umbach, P. D.
- Comparability of Data Gathered from Evaluation Questionnaires on Paper and Through the Internet; 2005; Leung, D., Kember, D.
- College Student Responses to Web and Paper Surveys: Does Mode Matter?; 2003; Hayek, J. C., Ouimet, J. A., Carini, R. M., Kennedy, J. M., Kuh, G. D.
- Assessing Response Rates And Nonresponse Bias In Web And Paper Surveys; 2003; Sax, L. J., Gilmartin, S. K., Bryant, A. N.
- The Impact of Lottery Incentives on Student Survey Response Rates; 2003; Whitcomb, M. E., Porter, S. R.
- Electronic versus traditional student ratings of instruction; 1999; Layne B. H., DeCristoforo, J. R., McGinty, D.