Notice: the WebSM website has not been updated since the beginning of 2018.

Web Survey Bibliography

Title Web Surveys Versus Other Survey Modes: An Updated Meta-analysis Comparing Response Rates
Year 2016
Access date 01.06.2016
The aim of this meta-analysis is to update a previous meta-analysis by Lozar Manfreda et. al. (2008), synthesizing experiments published between 1998 and 2005 on response rate differences between Web and other survey modes. Based on 45 experimental studies identified, Web surveys yielded 11% lower response rates on average compared to all other modes. Furthermore, substantial variability around this average effect size was discovered, which could have been partially explained by the sample recruitment base, the solicitation mode and the number of contacts. Other factors as the type of mode web was compared to, type of target population, sponsorship, publication year or incentives showed no significant influence in this previous study. However, the original study by Lozar Manfreda et. al. (2008) faced a statistical power problem due to small numbers of observations for certain moderator levels. Since 2005, numerous studies carrying information about response rates differences between Web and other survey modes have been published. Consequently, we seek to address the following research questions in our update:How robust are the previous findings over time? Do web surveys still yield lower, the same, or even larger response rates? If we still detect any effects, which factors influence response rate differences? To identify studies published after 2005, we used the same eligibility criteria employed by Lozar Manfreda et. al. (2008) and have identified 94 experimental comparisons altogether, extracted from 57 papers. The overall findings indicate a remarkably robust response rate difference over time (12% lower response rates for Web surveys on average). Moreover, because of the increased number of primary studies, we were able to get more accurate estimates for all moderator variables (type of comparison mode, sample recruitment base, target population, sponsorship, solicitation mode, incentives, number of contacts, publication year) considered. Practical implications and avenues for future research are being discussed.
Year of publication2016
Bibliographic typeConferences, workshops, tutorials, presentations

Web survey bibliography - The American Association for Public Opinion Research (AAPOR) 71st Annual Conference, 2016 (107)