Web Survey Bibliography
Background: There has been limited study of factors influencing response rates and attrition in online research. Online experiments were nested within the pilot (study 1, n = 3780) and main trial (study 2, n = 2667) phases of an evaluation of a Web-based intervention for hazardous drinkers: the Down Your Drink randomized controlled trial (DYD-RCT).
Objectives: The objective was to determine whether differences in the length and relevance of questionnaires can impact upon loss to follow-up in online trials.
Methods: A randomized controlled trial design was used. All participants who consented to enter DYD-RCT and completed the primary outcome questionnaires were randomized to complete one of four secondary outcome questionnaires at baseline and at follow-up. These questionnaires varied in length (additional 23 or 34 versus 10 items) and relevance (alcohol problems versus mental health). The outcome measure was the proportion of participants who completed follow-up at each of two follow-up intervals: study 1 after 1 and 3 months and study 2 after 3 and 12 months.
Results: At all four follow-up intervals there were no significant effects of additional questionnaire length on follow-up. Randomization to the less relevant questionnaire resulted in significantly lower rates of follow-up in two of the four assessments made (absolute difference of 4%, 95% confidence interval [CI] 0%-8%, in both study 1 after 1 month and in study 2 after 12 months). A post hoc pooled analysis across all four follow-up intervals found this effect of marginal statistical significance (unadjusted difference, 3%, range 1%-5%, P = .01; difference adjusted for prespecified covariates, 3%, range 0%-5%, P = .05).
Conclusions: Apparently minor differences in study design decisions may have a measurable impact on attrition in trials. Further investigation is warranted of the impact of the relevance of outcome measures on follow-up rates and, more broadly, of the consequences of what we ask participants to do when we invite them to take part in research studies.
Journal Homepage (abstract) / (full text)
Web Survey Bibliography - United Kingdom (395)
- Flexible insulin dosing improves health-related quality-of-life (HRQoL): a time trade-off survey; 2013; Evans, M. et al.
- Research staff and public engagement: a UK study; 2013; Davies, S.
- Reaching and Hearing the Invisible: Organizational Research on Invisible Stigmatized Groups via Web...; 2013; Trau, R. N. C. et al.
- The Role of Mode Preference Questions in Predicting Mode-Specific Response Propensities; 2013; Lynn, P., Kaminska, O.
- Development of a Questionnaire and Cross-Sectional Survey of Patient eHealth Readiness and eHealth Inequalities...; 2013; Jones, R.
- A report on the Confirmit Market Research Software Survey 2013; 2013; Macer, T., Wilson, S.
- Enhancing student engagement in student experience surveys: a mixed methods study; 2013; Webber, M., Lynch, S., Oluku, J.
- Where Am I? A Meta-Analysis of Experiments on the Effects of Progress Indicators for Web Surveys; 2013; Villar, A., Callegaro, M., Yang, Y.
- Web Coverage in the UK and its Potential Impact on General Population Web Surveys; 2013; Callegaro, M.
- Issues of Coverage and Sampling in Web Surveys for the General Population; 2013; Lynn, P.
- Web psychosocial surveys in cancer survivorship - a methodological note; 2013; Santin, O., Mills, M., Treanor, C., Mc Donald, G., Donnelly, M.
- Going online with a face-to-face household panel: initial results from an experiment on the Understanding...; 2013; Jaeckle, A., Lynn, P., Burton, J.
- Targeted response inducement strategies on longitudinal surveys; 2013; Lynn, P.
- Research note: E-store image, perceived value and perceived risk; 2013; Chang, E. -C., Tseng, Y. -F.
- Retail relationships in a digital age; 2013; Keeling, K., Keeling, D., McGoldrick, P.
- Gamification Master Class; 2013; Puleston, J.
- Research Communities in Asia Pacific: A review of similarities and contrasts; 2013; Poynter, R.
- Advanced Research Methods Training in the UK: Current Provision and Future Strategies; 2013; Moley, S., Wiles, R., Sturgis, P.
- Doing real time research: Opportunities and challenges; 2013; Back, L., Lury, C., Zimmer, R.
- ‘Digital Methods as Mainstream Methodology’: Building capacity in the research community...; 2013; Roberts, S., Hine, C., Morey, Y., Snee, H., Watson, H.
- New social media, new social science?; 2013; Woodfield, K., Morrell, G.
- Digital technology and data collection; 2013; Henriksen, B., Jewitt, C., Price, S., Sakr, M.
- From Face‐to‐face to Web: Consequences for Measurement of Complex and Open‐ended Questions...; 2013; Villar, A., Fitzgerald, R., Martin, P., Harrison, E., Gatrrell, L.
- The Technology Behind Mobile Research: Browsers vs. Apps ; 2013; Macer, T.
- Impact of mode design on reliability in longitudinal data; 2013; Cernat, A.
- Exploring the results of pre-testing questions developed for the European Social Survey: Comparing...; 2013; Widdop, S.
- The 2012 Confirmit Annual Market Research Software Survey; 2013; Macer, T., Wilson, S.
- Online survey of insolvency professionals undertaken for TSO. Summary analysis prepared for survey participants...; 2013; Tribe, J., Purdy, D.
- A probability-based web panel for UK policy research: some initial thoughts from a Government survey...; 2013; Littlechild, J.
- A probability-based web panel for the UK: What could it look like?; 2013; Nicolaas, G.
- Current UK provision of web panaels and Omnibus; 2013; Lagorio, C.
- Feasibility of Using Web to Survey at a Sample of Addresses: a UK ESS experiment; 2013; Villar, A.
- What works? Getting the General Population To Go Online in a Mixed Mode Local Health Survey; 2013; Frigault, L.-R., Azzou, S. A. K., Molloy, E. J. K., Ammarguellat, F., Couture, M., Gratton, J.
- ONS Plans for Web Data Collection in LFS; 2013; Lound, C.
- On-line questionnaire completion time and personality test scores; 2013; Furnham, A., Hyde, G., Trickey, G.
- Questionnaire development & testing in the 21st century: What are the challenges?; 2013; Collins, D.
- Paradata in Web Surveys; 2013; Callegaro, M.
- The E-Interview in Qualitative Research; 2013; Bampton, R., Cowton, C., Downs, Y.
- The Distinctiveness of Online Research: Descriptive Assemblages, Unobtrusiveness, and Novel Kinds of...; 2013; Lanfrey, D.
- Advancing Research Methods with New Technologies; 2013; Sappleton, N.
- From mixed-mode to multiple devices. Web surveys, smartphone surveys and apps: has the respondent gone...; 2013; Callegaro, M.
- Using mobile devices to access the realities of youth: How identification with society influences political...; 2013; Smith, M.
- Web coverage in the UK and its potential impact on general population web surveys; 2013; Callegaro, M.
- Surveys on Mobile Devices: Opportunities and Challenges; 2013; Couper, M. P.
- Measurement effects in mixed-mode panel surveys; 2013; Lugtig, P. J.
- Life history calendars - a viable method for web-based data collection?; 2013; Glasner, T., van der Vaart, W.
- Measurement issues in web surveys: An overview of opportunities and challenges; 2013; Calderwood, L.
- Experiences from a probability-based Internet panel: Sample, recruitment and participation; 2013; Scherpenzeel, A.
- Participation and engagement in web surveys of the general population: An overview of challenges and...; 2013; Roberts, C.
- Using Web Survey Panels to Estimate Population Characteristics: A Comparison of Alternative Approaches...; 2013; Rivers, D.