Web Survey Bibliography
Background: There has been limited study of factors influencing response rates and attrition in online research. Online experiments were nested within the pilot (study 1, n = 3780) and main trial (study 2, n = 2667) phases of an evaluation of a Web-based intervention for hazardous drinkers: the Down Your Drink randomized controlled trial (DYD-RCT).
Objectives: The objective was to determine whether differences in the length and relevance of questionnaires can impact upon loss to follow-up in online trials.
Methods: A randomized controlled trial design was used. All participants who consented to enter DYD-RCT and completed the primary outcome questionnaires were randomized to complete one of four secondary outcome questionnaires at baseline and at follow-up. These questionnaires varied in length (additional 23 or 34 versus 10 items) and relevance (alcohol problems versus mental health). The outcome measure was the proportion of participants who completed follow-up at each of two follow-up intervals: study 1 after 1 and 3 months and study 2 after 3 and 12 months.
Results: At all four follow-up intervals there were no significant effects of additional questionnaire length on follow-up. Randomization to the less relevant questionnaire resulted in significantly lower rates of follow-up in two of the four assessments made (absolute difference of 4%, 95% confidence interval [CI] 0%-8%, in both study 1 after 1 month and in study 2 after 12 months). A post hoc pooled analysis across all four follow-up intervals found this effect of marginal statistical significance (unadjusted difference, 3%, range 1%-5%, P = .01; difference adjusted for prespecified covariates, 3%, range 0%-5%, P = .05).
Conclusions: Apparently minor differences in study design decisions may have a measurable impact on attrition in trials. Further investigation is warranted of the impact of the relevance of outcome measures on follow-up rates and, more broadly, of the consequences of what we ask participants to do when we invite them to take part in research studies.
Journal Homepage (abstract) / (full text)
Web Survey Bibliography (6797)
- Conceptualising and evaluating experiences with brands on Facebook; 2013; Smith, S.
- Lotteries and study results in market research online panels; 2013; Goeritz, A.; Luthe, S. C.
- Estimates on the effectiveness of web application firewalls against targeted attacks; 2013; Holm, H., Ekstedt, M.
- Respondent Rewards: Money for Nothing?; 2013; Martin, P.
- How to make your questionnaire mobile-ready; 2013; Cape, P. J.
- Did I Do That? How Trap Questions Can Hurt Data Quality; 2013; Phillips, K.
- Leveraging mobile and online qualitative to get inside shoppers’ heads; 2013; Bryson, J., Ritzo, J.
- A report on the Confirmit Market Research Software Survey 2013; 2013; Macer, T., Wilson, S.
- Thoughts on using the new online qualitative tools; 2013; Freund, N. M.
- Web Panel Representativeness; 2013; Bianchi, A., Biffignandi, S.
- Interactive applets on the Web for methods and statistics; 2013; Reips, U. -D., McClelland, G.
- Economic valuation in Web surveys; A review of the state of the art and best practices; 2013; Menegaki, A. N., Tsagarakis, K. P.
- Can creative web survey questionnaire design improve the response quality?; 2013; Angelovska, J., Mavrikiou, P. M.
- Utilization of High-Technology to Collect Health Risk Assessment Information from Medicare Members:...; 2013; Freedman, D., VanderHorst, N.
- An evaluation of mixed methods (diaries and focus groups) when working with older people; 2013; Koopman-Boyden, P., Richardson, M.
- Respondent Behavior Logging: An Opportunity for Online Survey Design; 2013; Sjoestroem, J., Rahman, M. H., Rafiq, A., Lochan, R., Agerfalk, P. J.
- Beyond Satisfaction Questionnaires: “Hacking” the Online Survey; 2013; Evans, A. L.
- Methodological Issues in the Design of Online Surveys for Measuring Unethical Work Behavior: Recommendations...; 2013; Wouters, K., Maesschalck, J., Peeters, C. F. W., Roosen, M.
- Use of mobile devices to answer online surveys: implications for research; 2013; Cunningham, J. A., Neighbors, C., Bertholet, N., Hendershot, C. S.
- Enhancing student engagement in student experience surveys: a mixed methods study; 2013; Webber, M., Lynch, S., Oluku, J.
- Where Am I? A Meta-Analysis of Experiments on the Effects of Progress Indicators for Web Surveys; 2013; Villar, A., Callegaro, M., Yang, Y.
- Field Lessons From the Delivery of Questionnaires to Young Adults Using Mobile Phones; 2013; van Heerden, A. C., Norris, S. A., Tollman, S. M., Stein, A. D., Richter, L. M.
- Comparison of Smartphone and Online Computer Survey Administration; 2013; Wells, T., Bailey, J., Link, M. W.
- Panel Conditioning in Difficult Attitudinal Questions; 2013; Binswanger, J., Schunk, D., Toepoel, V.
- Web Coverage in the UK and its Potential Impact on General Population Web Surveys; 2013; Callegaro, M.
- Issues of Coverage and Sampling in Web Surveys for the General Population; 2013; Lynn, P.
- Optimizing quality of response through adaptive survey designs; 2013; Schouten, B., Calinescu, M., Luiten, A.
- Attitudes of Nebraska Residents on Nebraska Water Management; 2013; Dillman, D. A., Edwards, M. L.
- Attitudes of Washington Residents on Washington Water Management; 2013; Dillman, D. A., Edwards, M. L.
- On the Impact of Response Patterns on Survey Estimates from Access Panels; 2013; Enderle, T., Muennich, R., Bruch, C.
- A Comparison of Data Quality Across Modes in a Mixed-Mode Collection of Administrative Records; 2013; Worthy, M., Mayclin, D.
- Reconceptualizing Survey Representativeness for Evaluating and Using Nonprobability Samples; 2013; Fan, D. P.
- To Click, Type, or Drag? Evaluating Speed of Survey Data Input Methods; 2013; Husser, J. A., Husser, J. A.
- Unit Nonresponse and Weighting Adjustments: A Critical Review; 2013; Brick, J. M.
- Web psychosocial surveys in cancer survivorship - a methodological note; 2013; Santin, O., Mills, M., Treanor, C., Mc Donald, G., Donnelly, M.
- Internet visual media processing: a survey with graphics and vision applications; 2013; Hu, S.-M., Chen, T., Xu, K., Cheng, M.-M., Martin, R. R.
- Measuring the impact of the Web: Rasch modelling for survey evaluation; 2013; Annoni, P., Weziak-Bialowolska, D., Farhan, H.
- Online Case Studies: HESI Exit Exam Scores and NCLEX-RN Outcomes; 2013; Young, A., Rose, G., Willson, P.
- The Challenges and Benefits of Distance Mentoring; 2013; Lach, H. W. et al
- Hail to Thee, Our Alma Mater: Alumni Role Identity and the Relationship to Institutional Support Behaviors...; 2013; McDearmon, J. T.
- Using Tablet Computers For “Intentional” Mobile Research; 2013; Seal, J.
- Encouraging Record Use For Financial Asset Questions In A Web Survey; 2013; Couper, M. P., Ofstedal, M. B., Lee, S.
- Experiments with methods to reduce attrition in longitudinal surveys; 2013; Fumagalli, L., Laurie, H., Lynn, P.
- Can Online Surveys Substitute Traditional Modes? An Error-Based Comparison of Online and On-Site Tourism...; 2013; Kim, N., Yu, X., Schwartz, Z.
- How incentives affect web-based survey response rates of athletic program donors; 2013; Alvarado, G., Callison, C.
- Investigating the Relationship among Prepaid Token Incentives, Response Rates, and Nonresponse Bias...; 2013; Parsons, N. L., Manierre, M. J.
- The Effect of Survey Mode on High School Risk Behavior Data: a Comparison between Web and Paper-based...; 2013; Raghupathy, S., Hahn-Smith, S.
- Web-Based Versus Traditional Paper Questionnaires: A Mixed-Mode Survey With a Nordic Perspective; 2013; Hohwue, L., Lyshol, H., Gissler, M., Hrafn Jonsson, S., Petzold, M., Obel, C.
- Going online with a face-to-face household panel: initial results from an experiment on the Understanding...; 2013; Jaeckle, A., Lynn, P., Burton, J.
- Targeted response inducement strategies on longitudinal surveys; 2013; Lynn, P.