Web Survey Bibliography
Background: There has been limited study of factors influencing response rates and attrition in online research. Online experiments were nested within the pilot (study 1, n = 3780) and main trial (study 2, n = 2667) phases of an evaluation of a Web-based intervention for hazardous drinkers: the Down Your Drink randomized controlled trial (DYD-RCT).
Objectives: The objective was to determine whether differences in the length and relevance of questionnaires can impact upon loss to follow-up in online trials.
Methods: A randomized controlled trial design was used. All participants who consented to enter DYD-RCT and completed the primary outcome questionnaires were randomized to complete one of four secondary outcome questionnaires at baseline and at follow-up. These questionnaires varied in length (additional 23 or 34 versus 10 items) and relevance (alcohol problems versus mental health). The outcome measure was the proportion of participants who completed follow-up at each of two follow-up intervals: study 1 after 1 and 3 months and study 2 after 3 and 12 months.
Results: At all four follow-up intervals there were no significant effects of additional questionnaire length on follow-up. Randomization to the less relevant questionnaire resulted in significantly lower rates of follow-up in two of the four assessments made (absolute difference of 4%, 95% confidence interval [CI] 0%-8%, in both study 1 after 1 month and in study 2 after 12 months). A post hoc pooled analysis across all four follow-up intervals found this effect of marginal statistical significance (unadjusted difference, 3%, range 1%-5%, P = .01; difference adjusted for prespecified covariates, 3%, range 0%-5%, P = .05).
Conclusions: Apparently minor differences in study design decisions may have a measurable impact on attrition in trials. Further investigation is warranted of the impact of the relevance of outcome measures on follow-up rates and, more broadly, of the consequences of what we ask participants to do when we invite them to take part in research studies.
Journal Homepage (abstract) / (full text)
Web Survey Bibliography - United Kingdom (340)
- The E-Interview in Qualitative Research; 2013; Bampton, R., Cowton, C., Downs, Y.
- The Distinctiveness of Online Research: Descriptive Assemblages, Unobtrusiveness, and Novel Kinds of...; 2013; Lanfrey, D.
- Advancing Research Methods with New Technologies; 2013; Sappleton, N.
- From mixed-mode to multiple devices. Web surveys, smartphone surveys and apps: has the respondent gone...; 2013; Callegaro, M.
- Using mobile devices to access the realities of youth: How identification with society influences political...; 2013; Smith, M.
- Web coverage in the UK and its potential impact on general population web surveys; 2013; Callegaro, M.
- Surveys on Mobile Devices: Opportunities and Challenges; 2013; Couper, M. P.
- Measurement effects in mixed-mode panel surveys; 2013; Lugtig, P. J.
- Life history calendars - a viable method for web-based data collection?; 2013; Glasner, T., van der Vaart, W.
- Measurement issues in web surveys: An overview of opportunities and challenges; 2013; Calderwood, L.
- Experiences from a probability-based Internet panel: Sample, recruitment and participation; 2013; Scherpenzeel, A.
- Participation and engagement in web surveys of the general population: An overview of challenges and...; 2013; Roberts, C.
- Using Web Survey Panels to Estimate Population Characteristics: A Comparison of Alternative Approaches...; 2013; Rivers, D.
- Online Research, Game On!; 2013; Puleston, J.
- The ONS Beyond 2011 Programme & possible implications for social surveys; 2013; Morris, L.
- Issues of Coverage and Sampling in Web Surveys for the General Population: An Overview; 2013; Lynn, P.
- How to create online questionnaires: A beginner's guide to survey design for businesses and students...; 2013; Lipscomb, L.
- Screenwise panel: Frequently Asked Questions; 2012
- Redeveloping the research section of Meningitis UK's website — A case study report; 2012; Witt, J. et al.
- Quality in market research. From theory to practice. 2nd Edition; 2012; Harding, D., Jackson, P.
- Ofcom technology tracker Wave 3; 2012
- Ofcom technology tracker Wave 2; 2012
- Not just playing around; 2012; Ewing, T.
- MRS Guidelines for online reseach; 2012
- Internet access - Households and individuals, 2012 part 2; 2012
- Internet access - Households and individuals, 2012; 2012
- How Should Debriefing Be Undertaken in Web-Based Studies? Findings From a Randomized Controlled Trial...; 2012; McCambridge, J., Kypri, K., Wilson, A.
- Multi-Language Multi-Continent B2B Community Panel: How B2B research can effectively span the world; 2012; Morden, M., Accomando, E.
- Can Survey Gaming Techniques Cross Continents? Examining cross cultural reactions to creative questioning...; 2012; Puleston, J.
- Device Diversity: Understanding the complexity of varied devices for taking surveys – Case study...; 2012; Pearson, C., Backlund, K., Veling, L., Tsvelik, M., Jehoel, S.
- Research Goes Mobile: Findings from initial smartphone application research; 2012; Dubreuil, C., Joubert, S.
- WebSM Study: Survey software features overview ; 2012; Vehovar, V.; Cehovin, G.; Kavcic, L.; Lenar, J.
- Measuring Work Activities and Skill Requirements of Occupations: Experiences from a European Pilot Study...; 2012; Tijdens, K., De Ruijter, E., De Ruijter, J.
- Using Free Online Survey Software in Your Teaching; 2012; Chippindall, J.
- Improving Representativeness In Online Surveys Using A Combined Internet/Postal Approach: Evidence From...; 2012; Atorough, P., Donaldson, B., Harris, A.
- An Initial Look at Non-Response and Attrition in Understanding Society; 2012; Lynn, P., Burton, J., Kaminska, O., Knies, G., Nandi, A.
- Understanding Society Innovation Panel Wave 4: Results from Methodological Experiments; 2012; Burton, J., Budd, S., Gilbert, E., Jaeckle, A., Kaminska, O., Uhrig, S.C. N., Brown, M., Calderwood,...
- The Propensity of Older Respondents to Participate in a General Purpose Survey; 2012; Lynn, P.
- Mode-Switch Protocols: How a Seemingly Small Design Difference can affect Attrition Rates and Attrition...; 2012; Lynn, P.
- Deep Data: Qualitative Approaches to E-Research in the Digital Age; 2012; Salmons, J.
- Going online with a face-to-face household panel: Initial results from an experiment on the UK Household...; 2012; Jaeckle, A., Lynn, P., Burton, J.
- The use of new technologies on the British Birth Cohort Studies; 2012; Calderwood, L.
- Opportunities and Challenges for the Digital Researcher; 2012; Blank, G., Morey, Y.
- Reliable Online Social Network Data Collection; 2012; Abdesslem, F. B., Parris, I., Henderson, T.
- Diasporas on the web: new networks, new methodologies; 2012; Crush, J., Eberhardt, C., Caesar, M., Chikanda, A., Pendleton, W., Hill, A.
- Evidence on the Comparison of Telephone and Internet Surveys for Respondent Recruitment.; 2012; Potoglou, D., Kanaroglou, P. S., Robinson, N.
- Case study: Respondent perspective on survey response; 2012; Jarrett, C.
- The Confirmit Annual Market Research Software Survey 2011; 2012; Macer, T.,
- Using e-surveys to access the views of football fans within online communities; 2012; Gibbons, T., Nuttall, D.
- Coverage error in internet surveys Can fixed phones fix it?; 2012; Vicente, P., Reis, E.