Web Survey Bibliography
Purpose of the study: While surveying online communities of different types for quantitative insights has become commonplace, very little is known about response inducing techniques that would secure higher unit response rates. This study aimed to investigate whether and how the design of email invitation letters could improve response rates and reduce unit non-response bias. Design/methodology/approach: Using a full-factorial between groups design an experiment with three manipulations in the content of email invitations, related to authority of the sender, plea for help, and sense of community, was implemented in a list-based web survey of a randomly selected sample of 2500 registered members of the largest online heath community in Slovenia. The aggregated response rates were analyzed with a series of bivariate comparisons and a multivariate binary logistic regression model. Findings: The overall aggregate response rate for all experimental groups was 8.4%. Invitations with more elements yielded a marginally significantly higher response with the largest difference between invitations with two (9.8%) and without any (5.4%) elements. Bivariate analysis showed that authority and plea for help had a positive effect on response, whilst sense of community did not have any effect. The logistic regression confirmed the positive main effect of plea for help. In addition, a significant interaction between sense of community and plea for help was unveiled: in cases where both elements were included in an invitation a lower unit response rate was more likely to be expected. Further, evidence on non-response bias was observed with more active online community users responding earlier. Originality/value: This study is among the first to empirically examine and quantify the impact of the content of email invitations on unit response rates in list-based web surveys in online communities. Using an experimental design it shows that an informed selection of response inducing elements in email invitations could significantly reduce the unit non-response. It also suggests that
the effect magnitude of different elements in invitations can vary considerably. Research limitations/implications: This study examined three elements of email invitations as experimental factors, even though there are probably many other invitation elements that interfere with this phenomenon. The findings apply only to list-based web surveys, meaning that important (sub)groups (e.g., lurkers) are excluded from the analysis. Practical implications: An appropriate and theory-informed use of response inducing elements in email invitations could importantly help online community managers and scholars to obtain more participation in web surveys of online community members. As such techniques are not cost-intensive they could be further optimized/tailored in the future to account for the specifics of different types of online communities.
Web survey bibliography - Slovenia (48)
- Overview: Online Surveys; 2017; Vehovar, V.; Lozar Manfreda, K.
- Introduction Breakoffs, Questionnaire Breakoffs and Web Questionnaire Length: A Metastudy ; 2016; Cehovin, G.; Vehovar, V.
- Web Surveys Versus Other Survey Modes: An Updated Meta-analysis Comparing Response Rates ; 2016; Wengrzik, J.; Bosnjak, M.; Lozar Manfreda, K.
- Investigating respondent multitasking in web surveys using paradata; 2016; Sendelbah, A.; Vehovar, V.; Slavec, A.; Petrovcic, A.
- The effect of email invitation elements on response rate in a web survey within an online community; 2016; Petrovcic, A.; Petric, G.; Lozar Manfreda, K.
- Identifying and correcting question-wording problems: the case of Wageindicator; 2015; Slavec, A., Vehovar, V., Tijdens, K. G.
- e-Social Science Perspective on Survey Process: Towards an Integrated Web Questionnaire Development...; 2015; Vehovar, V., Petrovcic, A., Slavec, A.
- Questionnaire length and breakoffs in web surveys: a meta study; 2014; Vehovar, V., Cehovin, G.
- Differences in intrapersonal and interactional empowerment between lurkers and posters in health-related...; 2014; Petrovcic, A., Petric, G.
- About the Institute of Public Health - Data aspect; 2013; Zaletel, M.
- The effect of email invitation characteristics and response reluctance on non-response in web forum...; 2013; Petrovcic, A., Lozar Manfreda, K., Petric, G.
- Different approaches to measure ego-centered social support networks: a meta-analysis; 2013; Hlebec, V., Kogovsek, T.
- Exploring patterns of academic usage: A Google Scholar based study of ESS, EVS, WVS and ISSP academic...; 2013; Malnar, B.
- Data quality of questions sensitive to social-desirability bias in web surveys; 2012; Lozar Manfreda, K., Zajc, N., Berzelak, N., Vehovar, V.
- WebSM Study: Survey software features overview ; 2012; Vehovar, V., Cehovin, G., Kavcic, L., Lenar, J.
- Costs and Errors in Fixed and Mobile Phone Surveys; 2012; Vehovar, V., Slavec, A., Berzelak, N.
- Impact of Fixed Choice Design on Blockmodeling Outcomes; 2012; Znidarsic, A.
- Web Survey Software; 2012; Berzelak, N., Vehovar, V., Slavec, A.
- Surveying general population: What types of experiments are further needed?; 2012; Vehovar, V., Berzelak, N.
- Research design for studying online communities with web surveys; 2012; Petrovcic, A., Petric, G., Lozar Manfreda, K.
- Effect of different stimulus on data quality in online panels; 2012; Zagar, S., Lozar Manfreda, K.
- Web panels in Slovenia; 2012; Lenar, J., Vehovar, V.
- Adaptation of Cognitive Interviews for Web; 2012; Mohorko, A., Hlebec, V.
- Current Projects at University of Ljubljana; 2011; Lozar Manfreda, K.
- Web survey software; 2011; Slavec, A., Berzelak, N., Vehovar, V.
- Web Survey Process within the Concept of eSocial Sciences; 2011; Vehovar, V.
- The Impact of Non-Response Treatments on the Stability of Blockmodels; 2011; Znidarsic, A., Ferligoj, A., Doreian, P.
- The influence of Social Support and Personal Networks on Doctoral Student Performance; 2011; Hlebec, V., Kogovsek, T., Ferligoj, A.
- From Busy Bees to Science Geeks and Party Animals: A Typology of Slovenian Doctoral Students; 2011; Hlebec, V., Kogovsek, T., Ferligoj, A.
- PhD Students’ Research Group Social Capital in Two Countries: A Clustering Approach with Duocentred...; 2011; Coenders, G., Coromina, L., Ferligoj, A., Guia, J.
- Optimization of dual frame telephone survey designs; 2011; Slavec, A., Vehovar, V.
- Nonresponse in Web Surveys ; 2011; Lozar Manfreda, K., Berzelak, N., Vehovar, V.
- Archiving and Re-using Qualitative and Qualitative Longitudinal Data in Slovenia; 2010; Stebe, J., Hudales, J., Kragelj, B.
- National readership surveys: Moving from probability face-to-face surveys to Internet panels; 2009; Vehovar, V., Slavec, A., Petric, I., Sargac, M.
- Relations between functionality and usability of Web survey software tools: An empirical evaluation; 2009; Berzelak, N., Lozar Manfreda, K.
- Optimising survey costs in mixed mode environment; 2009; Vehovar, V., Berzelak, N., Lozar Manfreda, K., Belak, E.
- Effectiveness of incentives in web surveys within mixed-mode systems: An evaluation of errors & costs...; 2009; Lozar Manfreda, K.
- "Mobile phone surveys in mixed mode environment: Balancing costs and errors"; 2009; Vehovar, V.
- Mobile phone surveys in mixed mode environment; 2009; Vehovar, V.
- What Can We Achieve With 5 Euros? Optimization of Survey Data Quality Using Mixed-Mode Approaches; 2008; Berzelak, N., Vehovar, V., Lozar Manfreda, K.
- Measuring ties on online forums; 2008; Ziberna, A., Vehovar, V., Jakulin, A.
- Integration of the web into survey data collection: Balancing costs and errors; 2008; Vehovar, V., Berzelak, N., Lozar Manfreda, K.
- Measuring ego-centered social networks on the web: Questionnaire design issues ; 2008; Vehovar, V., Lozar Manfreda, K., Koren, G., Hlebec, V.
- Collecting Data on Ego-Centered Social Networks on the Web: Methodological Issues; 2004; Lozar Manfreda, K., Vehovar, V., Hlebec, V.
- Nonresponse in Web Surveys; 2002; Vehovar, V., Lozar Manfreda, K., , Batagelj, Z.
- Web survey errors; 2001; Lozar Manfreda, K.
- Virtual Selves and Web Surveys; 2001; Lozar Manfreda, K., Couper, M. P., Vohar, M., Rivas, S., Vehovar, V.
- Internet v Sloveniji - Projekt RIS 1996-1998.; 1998; Vehovar, V.