Web Survey Bibliography
Title Internet Versus Mailed Questionnaires: A Randomized Comparison
Author Ritter, P., Lorig, K., Laurent, D., Matthews, K.
Source Journal of Medical Internet Research, 6, 3
Year 2004
Access date 20.12.2004
Full text doc (126k)
Abstract Background: The use of Internet-based questionnaires for collection of data to evaluate patient education and other interventions has increased in recent years. Many self-report instruments have been validated using paper-and-pencil versions, but we cannot assume that the psychometric properties of an Internet-based version will be identical.
Objectives: To look at similarities and differences between the Internet versions and the paper-and-pencil versions of 16 existing self-report instruments useful in evaluation of patient interventions.
Methods: Participants were recruited via the Internet and volunteered to participate (N=397), after which they were randomly assigned to fill out questionnaires online or via mailed paper-and-pencil versions. The self-report instruments measured were overall health, health distress, practice mental stress management, Health Assessment Questionnaire (HAQ) disability, illness intrusiveness, activity limitations, visual numeric for pain, visual numeric for shortness of breath, visual numeric for fatigue, self-efficacy for managing disease, aerobic exercise, stretching and strengthening exercise, visits to MD, hospitalizations, hospital days, and emergency room visits. Means, ranges, and confidence intervals are given for each instrument within each type of questionnaire. The results from the two questionnaires were compared using both parametric and non-parametric tests. Reliability tests were given for multi-item instruments. A separate sample (N=30) filled out identical questionnaires over the Internet within a few days and correlations were used to assess test-retest reliability.
Results: Out of 16 instruments, none showed significant differences when the appropriate tests were used. Construct reliability was similar within each type of questionnaire, and Internet test-retest reliability was high. Internet questionnaires required less follow-up to achieve a slightly (non-significant) higher completion rate compared to mailed questionnaires.
Conclusions: Among a convenience sample recruited via the Internet, results from those randomly assigned to Internet participation were at least as good as, if not better than, among those assigned mailed questionnaires, with less recruitment effort required. The instruments administered via the Internet appear to be reliable, and to be answered similarly to the way they are answered when they are administered via traditional mailed paper questionnaires.
Objectives: To look at similarities and differences between the Internet versions and the paper-and-pencil versions of 16 existing self-report instruments useful in evaluation of patient interventions.
Methods: Participants were recruited via the Internet and volunteered to participate (N=397), after which they were randomly assigned to fill out questionnaires online or via mailed paper-and-pencil versions. The self-report instruments measured were overall health, health distress, practice mental stress management, Health Assessment Questionnaire (HAQ) disability, illness intrusiveness, activity limitations, visual numeric for pain, visual numeric for shortness of breath, visual numeric for fatigue, self-efficacy for managing disease, aerobic exercise, stretching and strengthening exercise, visits to MD, hospitalizations, hospital days, and emergency room visits. Means, ranges, and confidence intervals are given for each instrument within each type of questionnaire. The results from the two questionnaires were compared using both parametric and non-parametric tests. Reliability tests were given for multi-item instruments. A separate sample (N=30) filled out identical questionnaires over the Internet within a few days and correlations were used to assess test-retest reliability.
Results: Out of 16 instruments, none showed significant differences when the appropriate tests were used. Construct reliability was similar within each type of questionnaire, and Internet test-retest reliability was high. Internet questionnaires required less follow-up to achieve a slightly (non-significant) higher completion rate compared to mailed questionnaires.
Conclusions: Among a convenience sample recruited via the Internet, results from those randomly assigned to Internet participation were at least as good as, if not better than, among those assigned mailed questionnaires, with less recruitment effort required. The instruments administered via the Internet appear to be reliable, and to be answered similarly to the way they are answered when they are administered via traditional mailed paper questionnaires.
Year of publication2004
Bibliographic typeJournal article
Web Survey Bibliography - Journal of Medical Internet Research (41)
- Internet-Based Recruitment to a Depression Prevention Intervention: Lessons From the Mood Memos Study...; 2013; Morgan, A. J., Jorm, A. F., Mackinnon, A. J.
- Challenges for Researchers Investigating Contraceptive Use and Pregnancy Intentions of Young Women Living...; 2013; Herbert, D. L., Loxton, D., Bateson, D., Weisberg, E., Lucke, J. C.
- An Assessment of Incentive Versus Survey Length Trade-offs in a Web Survey of Radiologists; 2013; Ziegenfuss, J. Y., Niederhauser, B. D., Kallmes, D., Beebe, T. J.
- How Should Debriefing Be Undertaken in Web-Based Studies? Findings From a Randomized Controlled Trial...; 2012; McCambridge, J., Kypri, K., Wilson, A.
- Use of Web 2.0 to Recruit Australian Gay Men to an Online HIV/AIDS Survey; 2012; Theriault, N., Bi, P., Hiller, J. E., Nor, M.
- Conducting Research on the Internet: Medical Record Data Integration with Patient-Reported Outcomes; 2012; Cascade, E., Marr, P., Winslow, M., Burgess, A., Nixon, M.
- Clinicians’ Perspectives on a Web-Based System for Routine Outcome Monitoring in Old-Age Psychiatry...; 2012; Veerbeek, M. A., Voshaar, R. C. O., Pot, A. M.
- Active-Q: Validation of the Web-Based Physical Activity Questionnaire Using Doubly Labeled Water; 2012; Bonn, S. E., Trolle-Lagerros, Y., Christensen, S. E., Moeller, E., Wright, A., Sjoelander, A., Baelter...
- Validation of an Informant-Reported Web-Based Data Collection to Assess Dementia Symptoms; 2012; Rockwood, K., Zeng, A., Leibman, C., Mucha, L., Mitnitski, A.
- Web-Based Recruiting for Health Research Using a Social Networking Site: An Exploratory Study; 2012; Fenner, Y., Garland, P., Moore, E. E., Jayasinghe, Y., Fletcher, A., Tabrizi, S. N., Gunasekaran, B.,...
- Broad Reach and Targeted Recruitment Using Facebook for an Online Survey of Young Adult Substance Use...; 2012; Ramo, D. E., Prochaska, J. J.
- Impact of Length or Relevance of Questionnaires on Attrition in Online Trials: Randomized Controlled...; 2011; McCambridge, J., Kalaitzaki, E., White, I. R., Khadjesari, Z., Murray, E., Linke, S., Thompson, S. G...
- Methodological Issues in Internet-Mediated Research: A Randomized Comparison of Internet Versus Mailed...; 2011; Whitehead, L.
- Using web-based and paper-based questionnaires for collecting data on fertility issues among female...; 2011; Van Den Berg, M. H., Overbeek, A., van der Pal, H. J. H., Versluys, B. A., , Van Leeuwe, F. E. Lambalk...
- Development of a Web-Based Survey for Monitoring Daily Health and its Application in an Epidemiological...; 2011; Sugiura, H., Ohkusa, Y., Akahane, M., Sano, T., Okabe, N., Imamura, T.
- Bias in Online Recruitment and Retention of Racial and Ethnic Minority Men Who Have Sex With Men; 2011; Amsden, M., Coggia, T., DiClemente, R. J., Khosropour, C. M., Luisi, N., Sullivan, P. S., Wingood, G...
- A Comparison of Psychometric Properties Between Internet and Paper Versions of Two Depression Instruments...; 2010; Andersson, G., Engstroem, I., Hollaendare, F.
- The Influence of Response Mode on Study Results: Offering Cigarette Smokers a Choice of Postal or Online...; 2010; Callas, P. W., Solomon, L. J., Hughes, J. R., Livingston, A. E.
- The Touro 12-Step: A Systematic Guide to Optimizing Survey Research with Online Discussion Boards; 2010; Ip, E. J., Barnett, M. J., Tenerowicz, M. J., Perry, P. J.
- Effects of a Financial Incentive on Health Researchers’ Response to an Online Survey: a Randomized...; 2010; Wilson, P. M., Petticrew, M., Calnan, M., Nazareth, I.
- Response Audit of an Internet Survey of Health Care Providers and Administrators: Implications for Determination...; 2008; Dobrow, M. J., Orchard, M. C., Golden, B.; Holowaty, E., Paszat, L., Brown, A. D., Sullivan, T.
- No Increase in Response Rate by Adding a Web Response Option to a Postal Population Survey: A Randomized...; 2007; Brøgger, J., Nystad, W., Cappelen, I., Bakke, P.
- Use of the Internet to communicate with health care providers in the United States: Estimates from the...; 2007; Beckjord, E. B., Squiers, L., Arora, N. K., Volckmann, L., Moser, R. P., Hesse, B. W., Finney Rutten...
- Response rate and completeness of questionnaires: A randomized study of internet versus Paper-and-Pencil...; 2007; Holm- Christensen, K., Hjollund, H. N., , ; Basnov, M.; Kongsved, S.M.
- Following Up Nonrespondents to an Online Weight Management Intervention: Randomized Trial Comparing...; 2007; Couper, M. P., Peytchev, A.; Strecher, V., Rothert, K., Anderson, K. J.
- Psychological Assessment via the Internet: A Reliability and Validity Study of Online (vs Paper-and-...; 2007; Vallejo, M. A., Jordán, C. M., Díaz, M. I., Comeche, M. I., Ortega, J.
- Formative Evaluation and Three-Month Follow-Up of an Online Personalized Assessment Feedback Intervention...; 2006; Cunningham, J. A., Humphreys, K., Kypri, K., van Mierlo, T.
- Computers and the Internet: Tools for Youth Empowerment; 2005; Valaitis, R. K.
- Information Needs and Visitors' Experience of an Internet Expert Forum on Infertility; 2005; Himmel, W., Meyer, J., Kochen, M. M., Michelmann, H.-W.
- How New Subscribers Use Cancer-Related Online Mailing Lists; 2005; Rimer, B. K., Lyons, E. J., Ribisl, K. M., Bowling, J. M., Golin, C. E., Forlenza, M. J., Meier, A.
- Use of Internet Audience Measurement Data to Gauge Market Share for Online Health Information Services...; 2005; Wood, F. B., Benson, D., LaCroix, E.-M., Siegel, E. R., Fariss, S.
- Challenges of Internet Recruitment: A Case Study with Disappointing Results; 2005; Koo, M., Skinner, H.
- Swiss Community Pharmacies' on the Web and Pharmacists' Experiences with E-commerce: Longitudinal study...; 2004; Zehnder, S., Bruppacher, R., Ruppanner, H., Hersberger, K. E.
- Improving the Quality of Web Surveys: The Checklist for Reporting Results of Internet E-Surveys (CHERRIES...; 2004; Eysenbach, G.
- Will Web Surveys Ever Become Part of Mainstream Research?; 2004; Schonlau, M.
- Internet Versus Mailed Questionnaires: A Randomized Comparison (2); 2004; Leece, P., Bhandari, M., Swiontkowski, M., Schemitsch, E., Tornetta, P., Devereaux, P. J., Guyatt, G...
- Internet Versus Mailed Questionnaires: A Randomized Comparison; 2004; Ritter, P., Lorig, K., Laurent, D., Matthews, K.
- Feasibility of Collecting Diary Data From Asthma Patients Through Mobile Phones and SMS (Short Message...; 2004; Anhoej, J., Moeldrup, C.
- Online consumer surveys as a methodology for assessing the quality of the United States health care...; 2004; Bethell, C., Fiorillo, J., Lansky, D., Hendryx, M., Knickman, J.
- Survey of Doctors' Experience of Patients Using the Internet; 2002; Potts, H. W. W., Wyatt, J. C., Pagerey, P.D.
- Using the Internet for surveys and health research; 2002; Eysenbach, G., Wyatt, J. C.